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Preface 


This  thesis  is  an  initial  attempt  to  use  reliability 
growth  models  to  predict  dormant  reliability.  It  can  actu¬ 
ally  be  thought  of  as  a  two-part  thesis.  The  first  part 
pertains  to  reliability  growth,  and  the  second  part  to  dor¬ 
mancy  and  the  Monte  Carlo  experiments. 

The  purpose  of  this  study  is  to  provide  evidence 
that  it  is  possible  to  predict  dormant  reliability  with 
reliability  growth  models.  My  hope  is  that  the  initial  work 
done  in  this  thesis  can  someday  be  expanded  to  provide  a 
sound  methodology  for  analyzing  dormant  reliability. 

The  original  idea  of  using  reliability  growth  models 
to  predict  dormant  reliability  was  conceived  by  my  Thesis 
Advisor,  Professor  Albert  H.  Moore.  I  am  sincerely  indebted 
to  him  for  his  inspiration  and  help  in  completing  this  study. 
Also,  I  would  like  to  thank  the  Reader  of  my  thesis,  Lt. 

Col.  Edward  J.  Dunne,  whose  constructive  criticism  was  an 
important  part  of  the  final  report.  Finally,  I  would  like 
to  express  great  thanks  to  my  wife,  Jackie,  whose  hours  at 
the  typewriter  played  an  essential  role  in  the  completion  of 
this  project. 


John  F.  VonLoh 
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Abstract 

This  thesis  presents  the  results  of  an  extensive 
literature  search  into  reliability  growth  and  the  subsequent 
use  of  three  reliability  growth  models  to  predict  dormant 
reliability.  A  brief  review  of  reliability  theory  is 
followed  by  a  survey  of  reliability  growth  models,  which 
includes  the  detailed  developments  of  and  specific  examples 
for  five  popular  models.  The  nature  of  dormant  reliability 
is  then  discussed  as  a  prelude  to  a  Monte  Carlo  analysis 
using  the  Duane,  Gompertz,  and  Bonis  reliability  growth 
models  to  predict  dormant  reliability. 


RELIABILITY  GROWTH  AND  ITS  APPLICATIONS 
TO  DORMANT  RELIABILITY 

I .  Introduction 

Reliability  of  dormant  weapon  systems  has  been  a 
concern  throughout  military  history  (Ref  32:7).  Many 
strategic  weapon  systems  in  the  Air  Force  today,  for  example, 
lie  in  a  dormant  state  for  years,  but  are  expected  to  per¬ 
form  reliably  when  needed.  Many  of  these  systems  are  vitally 
important  to  our  national  security.  In  addition,  there  is 
always  a  cost  associated  with  the  replacement  or  repair  of 
systems  when  they  fall  below  acceptable  reliability  levels. 
Since  reliability  has  a  direct  impact  on  the  mission  perform¬ 
ance  and  operating  cost  of  a  system,  it  follows  that  there 
}  a  need  to  assess  the  impact  of  dormancy  on  a  weapon 

I 

system. 

One  of  the  problems  with  dormancy  is  the  lack  of 

consistent  or  well-defined  methods  for  determining  its 

effects  (Ref  32:11).  This  fact  is  reinforced  by  remarks  in 

the  Introduction  of  a  report  by  J.  Bauer,  D.F.  Cottrell, 

T.R.  Cagnier,  and  E.W.  Kimball,  of  the  Martin-Marietta 

Corporation.  They  stated: 

...Documents  such  as  RADC  Reliability  Notebook  and 
MIL-HDBK-217A  depict  in  detail  operational  failure 
rate  data,  derating  factors,  environmental  factors, 
quality  factors,  etc.  Little  or  nothing  is  extant 
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on  the  o  t'ner  states  of  act  ivation- *  storage  ,  dormancy, 
and  power  on-off  cycling  [Ret  8:1-1]. 

These  statements  arc  evidence  that  there  is  knowledge  to  be 

gained  by  additional  research  into  dormant  reliability. 

A  general  definition  of  dormant  reliability  is  the 
change  in  reliability  of  a  s/stem  over  time  as  it  lies  in  a 
dormant  or  unused  state  (Ref  22:22).  There  is  no  single  or 
consistent  definition  of  exactly  what  constitutes  a  dormant 
state.  However,  most  of  the  literature  will  refer  to  a 
dormant  state  as  a  state  of  very  little  or  no  operational 
stress  (Ref  24:45).  For  example,  a  missile  system  to  which 
enough  power  is  added  to  see  if  the  components  are  function¬ 
ing  properly,  say  once  a  month,  could  be  considered  a  dor¬ 
mant  system.  Of  course,  the  effect  of  dormancy  on  a  system 
will  vary  with  the  system  and  the  environment  in  which  it  is 
stored.  In  most  cases,  however,  the  effect  of  dormancy  is 
an  increase  in  the  failure  rate  of  the  system  with  the  pas¬ 
sage  of  time. 

On  the  other  hand,  a  general  definition  of  reliability 
growth  is  a  continuing  decrease  in  a  system's  actual  failure 
rata  that  will  approach  an  inherent  value  of  the  system 
(Ref  31:330-331).  The  inherent  value  of  the  system  refers 
to  the  maximum  reliability  one  can' expect  from  a  system  based 
on  the  design  characteristics.  A  good  example  of  reliability 
growth  would  be  getting  the  "bugs"  out  of  a  new  car.  0nC3 
the  early  problem  areas  are  fixed,  the  car  will  perform  with 
a  higher  level  of  reliability  for  most  of  its  life. 


2 


Compared  with  reliability  growth,  dormant  reliability 
has  an  opposite  or  negative  effect.  With  reliability  growth 
the  failure  rate  will  be  decreasing,  while  with  dormant  reli- 
ability  the  failure  rate  will  be  increasing.  Intuitively 
then,  it  seems  that  the  methodology  used  to  determine  reli* 
ability  growth  could  be  applied  to  dormant  reliability. 

In  general,  the  nature  of  reliability  growth  modeling 
is  to  first  test  a  system,  then  analyze  the  results  of  thf 
tests,  and  finally  fix  the  system  (Ref  14:35).  The  procedure 
is  repeated  until  enough  data  are  obtained  ts  construct  a 
reliability  growth  curve.  From  the  reliability  growth  curve, 
estimations  of  future  reliability  of  the  system  can  be  made. 
Analogous  to  this  situation  is  a  dormant  system  which  is 
stared  and  tested  at  regular  intervals.  In  both  the  dormant 
case  and  the  case  where  reliability  growth  is  present,  the 
objective  is  to  determine  the  change  in  the  failure  rate  of 
the  system.  This  analogy  should  make  it  possible  to  use 
reliability  growth  models  to  estimate  dormant  reliability. 

Since  the  theme  of  this  study  hinges  on  an  in*depth 
understanding  of  reliability  growth,  the  first  objective 
will  be  to  present  a  survey  of  applicable  reliability  growth 
models.  Included  in  the  survey  will  be  a  detailed  discus* 
sion  of  five  reliability  growth  models  which  represent  the 
most  widely  used  models  that  are  capable  of  predicting 
future  reliability.  In  addition,  there  will  be  a  general 
discussion  of  other  reliability  growth  models  that  were 
found  in  the  literature  search. 
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In  light  of  the  analogy  between  reliability  growth 
and  dormant  reliability  (each  has  changing  failure  rates), 
research  to  determine  whether  reliability  growth  models  can 
be  used  to  estimate  dormant  reliability  would  be  important. 

This  is  because  much  work  has  already  been  done  in  reliabil¬ 
ity  growth.  This  reasoning  supports  the  second  objective  of 
this  study,  that  is  to  determine  with  relative  Hgoodness-of- 
fit"  measures  how  well  a  set  of  selected  reliability  growth 
models  fit  dormant  data  generated  by  Monte  Carlo  simulation. 
Simulation  was  used  so  the  underlying  failure  distributions 
would  be  known  and  could  be  used  to  calculate  the  true 
system  reliability.  The  true  system  reliability  was  used  as 
the  basis  for  comparison  in  the  relative  Mgoodness-of-fitM 
measures. 

To  achieve  the  study  objectives,  an  intensive  litera¬ 
ture  search  was  made  into  reliability  growth  and  dormant 
reliability.  The  results  of  this  literature  search  are  pre¬ 
sented  in  the  following  sections:  Section  XI  summarises 
some  of  the  key  relationships  associated  with  reliability 
theory  which  are  used  throughout  the  study;  Section  III 
discusses  reliability  growth  models;  Section  XV  is  a  general 
discussion  of  the  nature  of  dormant  reliability;  Section  V 
outlines  the  Monte  Carlo  simulation;  Section  VI  presents  the 

s 

results  of  the  Monte  Carlo  ex{>eriaeats;  and  finally.  Section  i 

| 

VII  contains  conclusions  to  the  study  and  recommendations  for  j 
further  research,  la  addition,  the  Appendix  contains  addi¬ 
tional  significant  data  resulting  from  the  Monte  Carlo  simulations 
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This  section  is  a  short  review  of  some  of  the  reli- 
ability  concepts  that  will  be  referred  to  in  this  study. 

It  is  intended  to  refaailiarize  the  reader  wth  the  import¬ 
ant  probabilistic  relationships  used  in  reliability  theory. 
In  addition,  emphasis  will  be  placed  on  general  notation 
that  is  used  in  this  report. 


The  Reliability  Function 

The  probability  of  a  system  failure  as  a  function 
of  time  (t)  is  defined  as 


P(T<t)  -  F(t) ,  t>0  (2.1) 

where  T  is  a  random  variable  denoting  time  to  failure.  F(t) 
is  the  cumulative  density  function  (cdf)  of  the  failure 
times,  or  the  probability  that  the  system  will  fail  by 
time  t. 

The  reliability  of  the  system  at  time  t  is  defined 
as 

R(t)  •  l-F(t)  •  P(T>t)  (2.2) 

where  R(t)  is  the  reliability  function.  If  the  random 
variable  T  has  a  probability  density  function  (pdf)  equal 
to  f(t),  then 

R(t)  -  l-F(t)  •  1  -  JT^f  (x)dx  -  £f(x)dx  (2.3) 


S 


where  x  is  used  as  the  variable  of  failure  tine  before  inte¬ 
gration  takes  place.  Eq  (2.3)  is  the  fundaaental  relation¬ 
ship  between  the  pdf  -  f(t),  the  cdf  -  F(t),  and  the 
reliability  function  -  R(t)  (Ref  30:9-10). 

In  this  study,  the  reliability  will  usually  be  de¬ 
noted  by  the  letter  R.  For  example,  the  reliability  as  a 
function  of  tine  would  be  R(t) ,  and  the  reliability  at  a 
specific  tine,  say  t  *  15,  would  be  R(15).  This  notation  is 
consistent  with  most  textbooks  and  articles  on  the  subject. 

The  Expected  Life  ; 

The  expected  life  of  a  system  is  the  time  during 
which  it  is  expected  to  perform  successfully  (Ref  30:10). 

If  the  random  variable  T  is  used  to  denote  time  to  failure, 
then  by  definition 

E(T)  •  j^tf(t)dt  (2.4) 

where  E(T)  is  the  expected  value  of  the  random  variable  T 
(Ref  38:121).  Another  convenient  expression  for  the  expected 
life  is 

E(T)  -  rt(t)dt  (2.5) 

This  expression  is  derived  as  follows.  Let  u  *  R(t)  and 
dv  ■  dt.  Then 

du  -  d[R(t)J  •  dll-F(t)]  -  d[-F(t)J  -  -f(t)dt 
and  v  ■  t.  Using  integration  by  parts. 
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/*R(t)dt  ■  /*  udv 

i  • 

■  uv  -  /"vdu 

-  [tR(t)  J  I"  ♦  r  tf(t)dt  (2.6) 

it  is  clear  that  when  t-0#  the  first  ten  of  (2.6)  is  also 
zero.  In  addition,  it  is  assuaed  that  R(t)  ■  0  at  t  -  ♦  • 
(reliability  is  a  decreasing  function  of  tine)  and  the  first 
ten  is  again  zero.  This  leaves  only  the  second  ten 

/**tf(t)dt  -  E(T)  (2.7) 

froa  Eq  (2.4). 

Tens  associated  with  E(T)  are  the  aean  tine  to  fail* 
ure  (MTTF)  or  aean  tine  between  failure  (MTBF) .  However, 
these  teras  should  be  used  only  when  the  failure  distribu¬ 
tion  function  is  specified.  The  reason  for  this  is  because 
the  reliability  at  the  MTBF  or  MTTF  is  not  generally  the 
saae  for  any  two  given  distributions.  For  exaaple,  the 
R(MTBF)  for  nomal  density  function  is  P(z>0)  *  .5.  However, 
R(MTBF)  for  the  negative  exponential  aodel  is  EXP(-I)  ■  .368 
(Ref  30:11). 

The  hazard  function,  h(t) ,  is  defined  as  the  instan¬ 
taneous  failure  rate  of  a  systea  at  tiae  t.  More  fomally, 
it  is  the  conditional  probability  that  a  systea  fails  in  the 
saall  interval  (t,t+At),  given  it  has  survived  until  tiae  t. 
The  relationship  between  h(t) ,  f (t) ,  F(t) ,  and  R(t)  is  as 


Relationshii 
Function  1 


to  the  Hazard 


follows 


h(t)  •  iffitT  "  Iff}  (2*8) 

The  derivation  of  this  relationship  can  be  found  in  Ref  30: 
11-15  or  Ref  31:135-137. 

A  special  case,  when  the  hazard  function  is  constant 
throughout  tine,  is  the  case  of  .he  neg  exponential  distri¬ 
bution  having  the  forn  (Ref  30:234) 

R(t)  -  EXP(-Xt),  t  >  0  (2.9) 

where 

R(t)  -the  reliability  at  tine  t 

X  »  the  instantaneous  failure  rate 
The  paraneter  of  the  nodel,  usually  denoted  by  X,  is  the 
hazard  rate  for  all  t  (Ref  30:234).  This  has  led  engineers 
to  refer  to  the  failure  rate  as  X  or  X(t)  in  many  cases. 
However,  care  nust  be  taken  to  assure  that  the  failure  rate 
referred  to  is  actually  the  instantaneous  failure  rate  and 
not  a  cumulative  failure  rate  or  failure  rate  over  a  speci¬ 
fied  interval.  It  nust  be  emphasized  that  the  relationship 
in  Eq  (2.8)  only  applies  when  the  instantaneous  failure 
rate  is  used.  In  this  study,  the  instantaneous  failure  rate 
will  be  denoted  by  h(t)  when  the  relationship  in  Eq  (2.8) 
is  expected  to  hold. 
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III.  Reliability  Jrowth 


The  failure  rate  of  a  system  in  its  early  life  or 
development  stage  is  often  characterized  by  change  (Ref  30: 
3).  Many  factors  can  cause  this  change.  For  example,  an 
equipment  may  have  a  faulty  component  that  is  redesigned  or 
replaced  with  a  better  component  which  will  cause  the  equip* 
ment  to  be  more  reliable  after  the  change.  Another  example 
would  be  the  increase  in  reliability  of  a  weapon  system, 
like  a  new  aircraft,  that  would  occur  after  the  operators 
became  more  familiar  with  how  it  worked.  This  phenomenon 
is  called  "reliability  growth." 

As  the  name  implies,  the  general  notion  is  that  tbe 
reliability  will  "grow"  to  some  inherent  value  (Ref  31:330- 
331) .  The  inherent  value  could  either  be  a  reliability  tar¬ 
get  set  for  the  system,  or  it  could  be  a  limiting  reliability 
based  on  the  design  of  the  system.  However,  an  increase  in 
reliability  need  not  be  the  only  case.  A  change  could  be 
made  that  would  be  detrimental  to  the  system.  The  point  is 
that  a  system  in  its  early  life  is  generally  not  character¬ 
ized  by  random  failures  of  a  constant  nature,  but  rather  by 
a  changing  failure  rate  that  hopefully  will  increase  with 
time.  ' 

The  Survey 

An  intensive  investigation  into  reliability  growth 
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was  conducted  for  two  reasons.  The  first  reason  was  to  deter* 
nine  if  reliability  growth  modeling  techniques  had  ever  been 
used  in  the  past  to  predict  dormant  reliability.  Secondly, 
an  in-depth  understanding  of  reliability  growth  was  needed 
for  the  experiments  on  dormant  reliability  in  the  latter  part 
of  this  study. 

The  literature  search  revealed  numerous  reliability 
growth  models.  Some  models  can  be  used  to  predict  future 
reliability  levels,  wh ■»  .e  others  cannot.  In  addition,  some 
models  are  quite  easy  o  use,  while  others  require  the  use 
of  more  complicated  procedures.  For  example,  the  Duane  model 
(Ref  22)  uses  a  simple  graphical  technique  to  estimate 
future  reliability,  while  Singpurwalla*s  technique  (Ref  53) 
requires  use  of  the  Box  and  Jenkins  time  series  analysis  pro* 
cedures  (Ref  11) ,  which  are  more  complicated.  For  these 
reasons,  not  every  model  was  studied  in  great  detail. 

To  give  the  reader  a  good  idea  of  what  reliability 

growth  involves,  five  models  are  discussed  in  detail  in  this 

* 

survey.  These  models  are:  1)  the  Duane  model;  2)  the  Crow 
model;  3)  Lloyd  and  Lipow's  hyperbolic  model;  4)  the  Gompertz 
model;  and  5)  the  Bonis  model  for  one  shot  devices.  'These 
models  were  chosen  because  they  are  widely  used  by  military 

analysts,  and  because  they  provide  a  good  cross* section  of 

■  -I 

reliability  growth  modeling  techniques.  Also,  they  were 
chosen  because  they  each  provide  a  predictive  functional 
relationship  for  the  reliabil.ey  growth  curves.  This  I 
feature  makes  it  possible  to  predict  reliability  levels  of 


future  times  t.  Some  models,  such  as  the  Barlow  and  Scheuer 
model  (Ref  5),  do  ^ot  have  this  capability. 

There  will  also  be  a  section  of  this  chapter  devoted 
to  other  reliability  growth  models.  Included  in  this  section 
will  be  a  brief  description  of  many  of  the  other  reliability 
growth  models.  The  intent  is  to  inform  the  reader,  in  a  very 
general  way,  about  each  of  these  models  and  to  provide  refer¬ 
ences  which  discuss  each  model  in  detail. 

The  Duane  Model 

J.T.  Duane,  of  the  General  Electric  Company,  developed 
a  reliability  growth  model  that  has  been  widely  used  in 
development  and  testing  programs  (Ref  22:563-566).  The  model 
has  been  used  extensively  by  the  military  since  its  first 
publication  in  1962.  The  idea  for  the  model  came  when  Duane 
noticed  that  the  plot  of  cumulative  mean  times  between  fail¬ 
ure  (MTBF)  fox  successive  test  intervals  would  many  times 
plot  as  a  straight  line  on  log-log  paper  (Ref  17:6).  Duane 
used  the  plots  to  determine  the  change  in  failure  rates  as  a 
function  of  time. 

The  Model.  The  basic  assumption  of  the  Duane  model 
is  that  a  testing  program  is  divided  into  intervals  (Ref  19: 
A1-A6).  Each  interval  could  represent  a  design  change  or 
engineering  modification,  but  the  failure  rate  for  any  given 
interval  would  remain  constant  during  that  interval.  This 
assumption  implies  that  the  reliability  during  any  specific 
interval  can  be  represented  by  the  negative  exponential  model , 
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R±Ct)  -  EXPt-Xjt],  t  >  0  (3.1) 

where 

R^t)  *  the  reliability  for  the  i**1  interval 
X^  ■  the  failure  rate  for  the  i**1  interval 
t  •  the  time 

i  «  1,2,...,  the  total  number  of  intervals 
Mathematically,  the  form  of  the  Duane  model  is 

Xc(t)  -  -  Kt‘a,  t  >  0,  K  >  0  (3.2) 

where 

X„(t)  ■  the  cumulative  failure  rate 
c 

N(t)  »  the  cumulative  number  of  failures 

t  ■  the  cumulative  test  time 

a  -  the  growth  rate  constant 

K  •  constant  that  represents  the  cumulative 
failure  rate  at  t  »  0 

The  instantaneous  failure  rate  can  be  derived  by  taking 
dN(t)/dt.  This  yields 

N(t)  -  It1’* 

. —  . *  (l-a)Kt"®  (3.3) 

where  X(t)  is  the  instantaneous  failure  rate.  From  this 
equation  the  reliability  can  be  calculated  for  a  time  t  that 
corresponds  to  the  i1^  interval  and,  thus,  X(t)  becomes  X^ 
in  Eq  (3.1). 

Parameter  Estimation.  Taking  logarithms  of  Eq  (3.2) 
gives  the  mathematical  representation  of  the  straight-line 


plots  on  log-log  paper  (Ref  19:A4).  The  resulting  equation 
is 

ln[^£^]  -  ln(K)  -  oln(t)  (3.4) 

From  this  equation,  two  methods  of  parameter  estimation 
emerge  (Ref  4:12-14).  First,  least  squares  can  be  used  by 
taking  the  ln(t)  and  the  ln[N(t)/t]  as  input.  Second,  a 
graphical  technique  can  be  employed  where  K  is  estimated  as 
the  intercept  of  the  plot  at  t  *  1  or  ln(t)  ■  0,  and  a  is 
estimated  as  the  negative  of  the  slope  of  the  line. 

Least  squares  may  be  the  more  exact  method  of  the 
two  (Ref  4:13),  but  the  graphical  technique  lets  the  analyst 
visualize  the  process  (Ref  15:458-459).  By  getting  a  visual 
perspective,  some  additional  insight  may  be  gained.  For 
example,  least  squares  techniques  would  not  point  out  a 
specific  outlier  in  the  data;  however,  if  the  graphical  tech¬ 
nique  was  used,  the  outlying  data  point  could  be  easily  seen. 

Example.  Suppose  the  data  listed  in  Table  I  contain 
the  cumulated  time  (t)  and  cumulated  failures  [N(t)J  of  a 
test  program  (Ref  19:A5).  The  cumulated  time  is  the  total 
test  time  for  the  item  or  items  on  test.  For  example,  if 
three  items  are  placed  on  test  for  one  hour,  the  cumulated 
time  is  three  hours.  In  this  case,  three  items  were  placed 
on  test,  and  as  a  failure  occurred,  appropriate  design 
changes  were  made  to  all  three  items.  They  were  then  put 
back  on  test  until  t  -  10.  Using  log-log  graph  paper,  t  is 
plotted  on  the  abscissa  and  N(t)/t  on  the  ordinate.  The 
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TABLE  I 


Cumulated  Test  Data 

« 


t 

N(t) 

N(t)/t 

1.00 

3 

3.00 

2.00 

6 

3.00 

5.00 

13 

2.60 

8.00 

18 

2.25 

10.00 

22 

2.20 

slope  is  then  computed  and  used  as  the  estimate  for  a.  In 
this  case,  the  slope  is  .148  ■  14.0mm/94. 3mm.  The  estimate 
for  K  is  simply  the  intercept  (ordinate  value)  at  t  «  .1, 
which  is  3.18.  Figure  1  shows  the  plot  of  the  data  as  well 
as  the  numbers  used  to  arrive  at  the  estimates  for  a  and  K. 

If  least  squares  are  used  to  estimate  the  parameters, 
ln(t)  is  considered  the  independent  variable  and  ln[N(t)/t] 
the  dependent  variable  (from  Eq  3.4).  The  results  of  using 
least  squares  estimators  on  the  data  in  Table  I  are  a  -  .147 
and  K  ■  3.15.  These  agree  closely  with  the  values  deter¬ 
mined  us ins  graphical  techniques. 

Once  values  for  K  and  a  have  been  found,  instantaneous 
failure  rates  can  be  calculated  using  Eq  (3.3).  Applying 
the  negative  exponential  model,  Eq  (3.1),  will  provide  esti¬ 
mates  of  reliability  at  any  specified  time.  However,  one 
must  realize  that  future  predictions  are  based  on  the  rate 
of  growth  or  deterioration  which  was  determined  from  the 


Fig  1.  Plot  of  Data  on  Log-T,og  Paper 

original  data.  In  other  words,  the  failure  rate  will  change 
consistently  with  time. 

The  least  squares  method  of  estimation  assumes  both 
independence  of  the  failure  times  and  also  constant  variance 
(Ref  37:389).  Since  this  is  usually  not  the  case  with  cumu¬ 
lative  data,  confidence  limits  using  least  squares  proper¬ 
ties  are  not  statistically  valid  (Ref  12:3).  However,  the 
Crow  model,  which  will  be  discussed  next,  uses  maximum 
likelihood  estimators  which  do  enable  the  analyst  to  calcu¬ 
late  confidence  limits. 

The  Crow  Model 

Larry  H.  Crow,  while  working  with  the  U.S.  Army 
Materiel  Systems  Analysis  Agency  (AMSAA) ,  took  the  Duane 
model  a  step  further.  Crow  used  the  mathematical  interpre¬ 
tation  of  the  straight-line  plots  of  the  cumulated  failure 
rate  on  log- log  paper  to  show  that  system  failure  times  were 
following  a  nonhomogeneous  Poisson  process  with  Weibull 
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intensity  (Ref  16:205-212). 

The  Model.  The  straight- line  plot  of  cumulated 
failure  rates  versus  cumulated  time  on  log- log  paper  means 

«  a  ♦  bln(t)  (3.5) 

which  is  Eq  (3.4)  of  the  Duane  model  where  ln(K)  ■  a  and 
-n  ■  b  (Ref  19*A2-A3),  Equating  N(t)  with  its  expected 
value  (assuming  an  exact  linear  relationship)  and  taking 
exponentials  gives 

ilNiiil  .  eatb  (3.o) 

or 

E(N(t)]  -  eatb+1  (3.7) 

Letting  B  -  b  ♦  1  and  a  *  ea  yields 

E[N(t)]  -  atB  (3.3) 

The  instantaneous  failure  rate,  h(t),  is  obtained  by  differ¬ 
entiating  Eq  (3.8)  with  respect  to  t.  This  gives 

h(t)  -  dN(t)/dt  -  aBtB" 1  (3.5) 

which  is  recognized  as  the  Weibull  hazard  function.  Of 
course,  the  assumption  that  failure  rates  remain  constant 
for  the  duration  of  any  interval  is  still  in  force.  This 
implies  that  failures  follow  a  nonhomogeneous  Poisson  pro¬ 
cess  with  Weibull  intensity  function  h(t) .  In  other  words, 
for  the  duration  of  any  interval  i,  Eq(3.1)  applies.  This 
is  consistent  with  the  assumption  of  the  Duane  model. 
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however,  the  changing  parameter,  Xj,  is  modeled  with  the 
Weibull  hazard  function  (Eq  3.9). 

Parameter  Estimation.  The  main  difference  between 
the  Crow  model  and  the  Duane  model  lies  in  the  method  of 
parameter  estimation  (Ref  16:207).  When  using  least  squares 
it  is  assumed  that  the  data  are  independent  with  constant 
variance.  Crow  points  out  that  the  Duane  model  assumes  the 
cumulated  failure  rates  are  consistently  increasing,  decrees 
ing,  or  remaining  the  same.  This  implies  the  data  are  not 
independent  (Ref  16:206).  In  addition,  the  variance  of  the 
cumulative  failure  rate  is  not  constant,  but  decreases  as 
time  increases  (Ref  16:206).  The  result  is  that  confidence 
bounds  of  a  and  B  using  least  squares  properties  are  not 
valid. 

Rather  than  using  least  squares  or  linear  estima¬ 
tions  from  log -log  paper.  Crow  uses  maximum  likelihood  (ML) 
estimatcrs.  The  form  of  the  ML  estimators  are 


and 


where 


i  a "  r f 
n 

\ 

N  ■  the  total  number  of  failures  observed 
t^  ■  time  at  th^  i*h  failure 
tR  ■  time  nt  the  Nth  failure 
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(3.10) 


(3.11) 


/ 


These  estimators  assume  a  single  reparable  system  with 
failures  that  follow  a  nonhomogeneous  Poisson  process  with 
Weibull  intensity.  When  a  failure  occurs,  the  system  is 
repaired  and  put  back  into  service,  and  the  repair  time  is 
considered  negligible  (Ref  18:383-388). 

The  existence  of  the  ML  estimators  mahe  it  possible 
to  calculate  confidence  intervals  (Ref  16:208).  In  addition. 
Crow  suggests  using  the  Craner-von  Mises  statistic  as  a 
test  for  the  appropriateness  of  the  model. 

Example.  Table  II  represents  data  from  a  test  pro¬ 
gram  truncated  after  the  Ntlx  failure  (Ref  19: All).  The 
first  step  is  to  estimate  B  and  a  using  the  ML  estimates, 
and  then  perform  a  goodness-of-fit  test  using  the  Cramer- 
von  Mises  test  statistic  (Ref  19:A12).  The  ML  estimate  of 
B  is 

b  - - Vi - -  TTcrassVreTgy  "  -4611  (3*12) 

(N-l)ln(t  )-  £  ln(t.) 

»  i*  * 

w  * 

The  ML  estimate  for  o  is 

a  «  -  - l*nvx  -  *0355  (3.13) 

tj  949. 7*4611 

The  Cramer- von  Mises  statistic  is  (Ref  19:A10) 

» 

**  ‘  TJH  *  •  TH1]  (J-l4) 

where 

M  •  N-2,  where  N  is  the  number  of  failures 
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TABLE  II 

Failure  Data  for  Crow  Model 


Failure 

Number 

Failure 

Tiae 

ln(tj) 

imctp 

1 

l.S 

.405 

.405 

2 

3.2 

1.163 

1.569 

3 

11.8 

2.468 

.  4.037 

4 

29.6 

3.388 

7.424 

5 

53.6 

3.982 

11.406 

6 

6S.2 

4.177 

15.583 

7 

119.4 

4.782 

20.366 

8 

265.3 

5.581 

25.947 

9 

294.0 

5.684 

31.630 

10 

441.1 

6.089 

37.720 

11 

465.1 

6.142 

43.862 

12 

567.0 

6.340 

50.202 

13 

685.8 

6.530 

56.733 

14 

831.4 

6.723 

63.456 

IS 

949.7 

6.856 

■  tine  of  i**1  failure 

■  tiae  of  the  N1*1  failure 

aa  a  a 

S'  ■  -jpB«  the  unbiased  estiaate  of  B 

2 

■  .0193  compared  with  a  critical  value  of  .169,  there¬ 
fore  the  model  cannot  be  rejected.  It  is  also  possible  to 
use  the  chi-square  goodness -of- fit  test  for  this  model 
(Ref  13:49'. 
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Since  the  model  is  appropriate,  the  instantaneous 
failure  rate  for  the  system  nay  be  estimated  by 

h(t)  -  oBt®*1  (3.15) 

or 

h(t)  -  .6:5S(.4611)t*’5389  (3.16) 

This  equation  will  produce  point  estimates  for  given  values 
of  t.  In  addition,  confidence  intervals  can  be  computed  for 

A  A  A 

o,  B,  and  h(t)  (Ref  19:A12-A13). 

This  model  has  found  wide  acceptance,  especially  by 
the  military  and  military  contractors.  The  Army  Materiel 
Development  and  Readiness  Command  (DARCOM)  pamphlet  P702-4 
has  several  numerical  examples  of  applications  of  the  Crow 
model  (sometimes  referred  to  as  the  AMSAA  model)  (Ref  19). 

In  addition,  Donald  P.  Amiotte  did  a  study  of  how  well  this  j 

model  tracks  data  (Ref  2).  ( 

The  Lloyd  and  Linow 
Hyperbolic  Model 

David  K.  Lloyd  and  Miron  Lipow  considered  a  relia-  I 

bility  growth  model  based  on  the  following  assumptions  (Ref  j 

31:338-347).  First,  a  test  program  is  conducted  in  N  stages,  j 

each  stage  consists  of  a  certain  number  of  tests  or  trials  j 

of  the  system  in  question,  and  the  only  data  recorded  is  j 

whether  the  system  was  a  success  or  failure.  In  addition, 

the  system  has  a  fixed  reliability  during  any  particular 

stage  and  the  results  of  the  testing  in  a  stage  are  used  to 

improve  the  system  in  the  subsequent  stage.  After  the  Nth 


stage,  a  reliability  growth  curve  is  fit  to  the  data. 

The  Model.  The  form  of  the  growth  function  at  the 


kth  stage  is 


where 


H  ’  R-  ‘  I 


(3.17) 


Rj'  -  the  reliability  after  the  ktfl  stage  of  testing 

Rm  •  the  ultimate  value  of  reliability  which  could 
be  attained  es  k  approaches  infinity 

a  •  parameter  which  modifies  the  growth  rate 

Parameter  Estimation.  There  are  two  methods  of 
parameter  estimation  suggested  by  Lloyd  and  Lipow  (Ref  31: 
337-347).  The  preferred  method  is  maximum  likelihood  (ML), 
but  the  ML  estimators  involve  two  equations  which  must  be 
solved  iteratively  by  trial  and  error.  This  process  could 
take  a  great  deal  of  time  without  good  initial  values.  This 
leads  to  the  second  method  of  estimation,  least  squares. 

Once  the  least  squares  estimators  are  found,  they  can  be 
used  as  initial  values  for  the  ML  estimators. 

Since  the  data  are  comprised  of  5^  successes  at  the 
k**1  stage,  the  likelihood  at  the  ktb  stage  is  given  by 


where 


Sk  A-s. 

Lk "  CRk  C1‘V  ? 


(3.18) 


L^  •  the  likelihood  at  the  k*®  stage 
C  •  a  constant 

Ac  *  sk^k  "  reliability  at  the.  k*b  stage 
»  the  number  of  successes  at  the  kth  stage 


Nk  -  the  number  of  items  tested  at  the  It  stage 
Assuming  each  stage  is  independent  gives  the  likelihood 


function 


N  Sv  VSk 
it  d  *  *“ 


i  •  n  l  •  c*  n  rv* U-RJ 

k-l  *  k-l  *  * 


(3.19) 


The  log- likelihood  function  is 

ln(L)  -  In(C’)  ♦  I  S^ln(R^)  ♦  r  C1*Rk)  (3*20) 

Substituting  R„  -  |  for  R^  from  Eq  (3.17)  yields 

N  a 

in(L)  -  m(c»)  ♦  -  ^) 

k-l 

♦  I  (Nk-Sk)ln(l-R„*£)  (3.21) 

k-l  *  * 

Taking  partial  derivatives  with  respect  to  each  parameter 
gives  the  likelihood  equations 


. .  *  N  St  K  -  Sk 

nniLl  .  t  - !  -  E  - * - “  - 

k-l  Rw  -  £  k-l  1  -  R„*  j 


(3.22) 


„  ...  N  Sv/k  N  (N.  -Sk)/k 

91”iU.  -  -I  — £—  ♦  r  — = — - - r  •  0  (3.23) 

k-l  R.  -  I  k-l  1  -  R,  ♦  E 

These  equations  can  be  solved  by  trial  and  error  to  obtain 
the  ML  estimates  for  R„  and  a. 

As  mentioned  earlier,  initial  values  for  o  and  R* 
can  be  determined  using  least  squares  techniques.  To 
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determine  the  least  squares  estimators,  let  Q  be  the  sum  of 


Example.  Suppose  10  items  were  tested  each  week  for 
10  consecutive  weeks.  After  each  test,  design  changes  were 
made  to  improve  the  system  based  on  the  results  of  the  test. 
Table  III  is  a  summary  of  the  data  collected  in  this  develop¬ 
ment  program.  When  N  (number  stages)  is  10,  •  2.93 

and  C,  •  Z-kr  -  1.55.  The  least  squares  estimates  are 

z  kz 


1.55(7.2)  -  2.93(1.59] 
10(1.55)  -  (2.93) ^ 

2.93(7.2)  -  10(1.59)  , 
10(1.55)  -  (2.93)2 


(3.31) 


(3.32) 


The  resulting  growth  function  is 

^  -  .938  -  (,745/k) 


(3.33) 


This  equation  will  give  the  reliability  for  any  of  the  N 
stages  by  substituting  in  the  appropriate  value  for  k. 

Of  course,  Eq  (3.33)  was  found  using  least  squares. 
If  the  ML  estimators  are  desired,  the  values  calculated  for 

A  A 

a  and  should  be  used  as  initial  values  in  Eqs  (3.22)  and 

A  A 

(3.23).  Values  for  a  and  Rw  can  be  changed  slightly  with 
each  iteration  until  Eqs  (3.22)  and  (3.23)  are  both  as  close 

A  A 

to  zero  as  possible.  The  resulting  values  of  a  and  Rm  are 
the  ML  estimators.  With  the  properties  associated  with  ML 
estimates,  the  analyst  can  also  find  confidence  limits  for 
the  estimators  and  the  reliabilities. 

Lloyd  and  Lipow  also  briefly  discuss  two  variations 
to  the  growth  model  shown  in  Eq  (3.17).  One  can  be  used 
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TABLE  III 

Data  from  Test  Program 


k 

Nk 

sk 

kSk 

VNk 

sk/kNk 

l 

10 

3 

3 

.3 

.300 

2 

10 

4 

8 

.4 

.200 

3 

10 

7 

21 

.7 

.230 

4 

10 

6 

24 

.6 

.150 

5 

10 

7 

35 

.7 

.140 

6 

10 

8 

48 

.8 

.130 

7 

10 

8 

56 

.8 

.114 

8 

10 

9 

72 

.9 

.113 

9 

10 

10 

90 

1.0 

.111 

10 

10 

10 

100 

1.0 

.100 

when  data  are  given  as  time* to- failure  rather  than  merely 
the  number  of  successes  (Ref  31:347).  The  other  uses 
binomial  data,  but  weighs  the  'urrent  estimate  cf  the  reli¬ 
ability  on  the  k**1  trial  with  ie  estimates  of  all  previous 
trials  (Ref  31:348).  4 

Lloyd  and  Lipow  alsc  *xoped  a  two-state  model 
(perfect  or  imperfect)  (Ref  3. .331-338).  However,  this 
model  is  restricted  by  the  assumption  that  failures  can 
occur  in  only  one  way.  In  other  words,  only  one  failure 
mechanism  is  allowed  when  using  the  model.  In  addition, 
no  consistent  estimators  for  the  parameters  are  provided 
(Lloyd  and  Lipow  do  not  provide  any,  and  Sherman,  who 
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conducted  a  study  on  ML  estimators  for  reliability  growth 
models,  confirmed  this  shortcoming)  (Ref  9:20). 

The  Gompertz  (Virene)  Model 

E.P.  Virene,  of  the  Boeing  Company,  used  the  Gompertz 
equation  as  a  general  reliability  growth  model  in  1968  (Ref 
56:265-270).  The  model  fits  a  reliability  growth  curve 
through  cumulated  percentage  points  of  reliability  plotted 
against  time.  The  model  has  been  used  to  determine  reliabil¬ 
ity  growth  in  government  programs  such  as  the  Lunar  Orb 4  ter 
Spacecraft  and  the  Blue  Scout  Launch  Vehicle  (Ref  56:265). 

The  Model.  The  form  of  the  Gompertz  equation  is 

ct 

R(t)  -  abc  ,  t  >  0  (3.34) 

where 

R(t)  •  system  reliability  at  time  t 

a  -  the  upper  limit  of  reliability  as  t 
approaches  infinity 

b  »  the  base  parameter 

c  ■  the  shape  parameter 

t  *  the  test  time  such  as  cycles  or  average 
operating  time  per  unit  equipment  age 

When  using  this  equation,  the  parameters  a  and  b  must  be 
between  zero  and  one.  In  addition,  parameter  c  must  be 
between  zero  and  one  if  reliability  growth  is  being  modeled. 

There  are  also  assumptions  concerning  the  variable 
t  (Ref  33:D-59).  The  values  of  t  must  be  in  the  same  units 
for  each  data  point  observed,  and  the  intervals  of  t  must  be 
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equal.  It  is  also  assumed  that  the  set  of  data  points  used 
to  estimate  the  parameters  are  divided  into  three  equally 
sized  groups. 

Parameter  Estimation.  Consider  data  used  to  esti¬ 
mate  parameters  in  the  logarithmic  form  (base  10) .  Then, 

Eq  (3.34)  becomes 

log  (R)  -  log  (a)  ♦  chogCb)  (3.35) 


The  logarithms  of  the  percentage  points  of  reliability  are 
summed  tip  in  each  of  the  three  groups  to  give 


n-1  [n-1  “I  ! 

S.  -  £  log(Ri>)  -  nlog(a)  ♦  E  cc  log'(b)  (3.36) 

1  t-o  1  Lt-o  J 

2n-l  Rtn-1  3 

S,  •  E  log(R1>)  -  nlog(a)  +  E  cc  log(b)  (3.37) 

*  t-n  *  Lt-0  J 

3n-l  pln-l  n 

S,  •  E  log(RJ  •  nlog(a)  ♦!  E  cr|log(b)  (3.38) 

3  t-2n  z  Lt*2n  J  ; 

;  ;  .  .  ;  ...  .  i  •  .  ,  . . 

where  n  ■  the  number  of  points  in  each  group  and  Rt  -  the 
percentage  reliability  for  the  t4*1  data  point.  The  first 
data  point  in  group  one  is  always  transformed  to  t  -  0. 
Subtraction  yields 


n-1  *  2n-l  J! 

E  cr  -  E  log(b)  (3.39) 
t»0  t«n  J 


and 


”2n-l  3n-l  , 

S-  -  S-  -  E  cl  -  E  c*  log(b)  (3.40) 

Lt-n  t«2n  _ 
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Taking  the  ratio  of  Eqs  (3.39)  to  (3.40)  gives 


'u  c  -  L  ' 

t»n  t«2n 


(3.41) 


By  changing  the  limits  of  the  summation  in  the  denominator 
of  Eq  (3.41),  cn  can  be  factored  out  to  give 


(3.42) 


(3.43) 
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Then  by  subtracting  Eq  (3.46)  from  Eq  (3.45),  the  following 
equation  results 


(3.47) 


Factoring  and  solving  for  the  first  term  gives 


(3.48) 


Substituting  Eq  (3.48)  into  Eq  (3.44)  for  the  summation  term 
gives  the  expression 


log(b) 


(S1  -  S2)(l  -  c) 
(1  -  cn)Z 


(3.49) 


which  is  the  estimate  for  parameter  b. 

The  final  parameter,  a,  is  estimated  by  making  sub¬ 
stitutions  from  Eq  (3.48)  and  Eq  (3.49)  into  Eq  (3.36)  and 
solving  for  log(a).  The  resulting  equation  is 

lo,(.)  -  i  [s,  -  (5.50) 

Example.  Suppose  the  data  in  Table  IV  summarize 
the  results  of  15  launches  of  a  missile  system.  Since  no 
successful  launches  occurred  until  the  fourth  launch,  no 
growth  was  assumed  and  group  one  (t  -  0)  starts  with  launch 
number  4  (Ref  56:268).  The  sum  of  the  groups  are 


Sx  -  1.398  +  1.301  *  1.223  +  1.456  -  5.378  (3.51) 

S2  -  1„574  ♦  1.647  +  1.699  ♦  1.736  -  6.656  (3.52) 
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TABLE  IV 

Missile  Data  for  Gompertz  Estimation 


Launch 

Number 

Success/ 

Failure 

t 

Reliability 
(1  R) 

log(R) 

1 

F 

- 

*  m  m 

' 

2 

F 

m 

m  m  m 

3 

F 

- 

•  • 

m  m  m 

4 

S 

0 

2S.0 

1.398 

S 

F 

1 

20.0 

1.301 

6 

F 

2 

16.7 

1.223 

7 

S 

3 

28.6 

1.456 

8 

S 

4 

37.5 

1.S74 

9 

S 

S 

44.4 

1.647 

10 

S 

6 

SO.O 

1.699 

11 

S 

7 

S4.S 

1.736 

12 

s 

8 

S8.2 

1.765 

13 

s 

9 

61.7 

1.790 

14 

s 

10 

64.2 

1.807 

IS 

s 

11 

66.7 

1.824  | 

S3  -  1.765  ♦  1.790  ♦  1.807  ♦  1.824 


From  Eq  (3.43) 


1  1 

_  fS2  *  S3>  _  f 6.656  -  7.186*]* 
[S1  "’SJ  "  L5TT73~”6.656J 


and  from  Eq  (3. SO) 


lo«(.)  -  i[st  -  -  l.MO 


(3.S5) 


Therefore,  a  •  77.6  •  the  upper  reliability  Unit. 
From  Eq  (3.49) 


log(b) 


Therefore 


(Sx  -S2)(l  -  c) 
(1  -  cn)2 


b  -  .182 


•  -.740 


(3.S6) 


and  the  reliability  equation  is 


R(t)  -  77.6(.182)*802t,  t>0  (3.57) 

Fron  this  equation,  the  reliability  for  any  past  or  future 
point  can  be  computed.  It  should  be  cautioned,  however, 
that  in  this  case  t  ■  0  is  considered  the  fourth  launch  and, 
subsequently,  R(t)  is  the  reliability  for  the  (t  ♦  4)th 
launch. 

Virene  also  cautions  that  when  using  this  nodal,  a 
goodness-of-fit  by  comparison  should  be  made  as  r  check  for 
suitability.  The  argument  is,  if  the  nodal  compares  favorably 
with  existing  data,  then  projections  made  with  the  model  will 
also  be  good  (Ref  56:266). 

The  Bonis  Model 

Austin  J.  Bonis,  of  the  Rochester  Institute  of  Tech¬ 
nology,  used  a  modified  exponential  function  to  model 
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reliability  growth  of  one  shot  devices  (Ref  1C:181~18S). 

The  model  is  not  only  capable  of  producing  reliability  growth 
curves  fro*  test  data,  it  can  also  produce  a  "target”  growth 
curve  for  a  test  prograa.  The  target  growth  curve  can  be 
used  to  monitor  progress  towards  the  reliability  goal  set 
for  the  prograa. 


The  Model.  The  aatheaatical  fora  of  the  Bonis  aodel 


Rk  -  R„  -  QBk‘X  (S.S8) 


Rj,  -  the  reliability  on  the  ktk  test 

Ra  ■  the  ultimate  value  of  reliability  that  could 
be  attained  if  k  were  allowed  to  increase 
without  limit 

Q  •  the  initial  unreliability  or  probability  of 
failure  before  the  test  begins 

B  *  the  improvement  factor 

k  •  the  number  of  the  stage 

The  constant,  Rn,  will  shift  the  curve  up  or  down  by  a  con* 
stant  amount. 

-J 

A  somewhat  limiting  factor  is  that  the  improvement 
factor,  B,  is  constant  throughout  the  process.  This  means  I 
whatever  improvement  factor  ia  estimated,  is  assumed  to  be 
the  constant  improvement  factor  for  the  entire  test  prograa.  I 

f 

Parameter  Estimation.  The  parameters  in  this  model  j 
are  estimated  by  solving  the  equation  that  represents  the  j 
fiTtt  three  stages  (Ref  10:183).  The  equations  for  the  j 

first  three  stages  are 
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is 

where 


(3.59) 


Rx  -  R„  -  QB° 

R2  ■  R„  -  QBl  (3.60) 

R3  -  R.  -  QB2  (3.61) 

Subtraction  yields 

R1  ‘  R2  "  “Q(B°  '  “  'Q(1  ’  B)  (3.62) 

and 

R2  -  R3  -  -QfB1  -  B2)  -  -QB(1  -  B)  (3.63) 


By  dividing  Eq  (3.62}  into  Eq  (3.63) 


B 


(3.64) 


which  is  the  estimate  for  B.  Also,  solving  for  Q  in  Eq 
(3.62)  gives 


(3.65) 


Finally,  Ra  is  determined  by  solving  Eq  (3.59) 

R„  •  Rx  ♦  Q  (3.66) 


When  using  Eqs  (3.64),  (3.65),  and  (3.66)  to  esti¬ 
mate  the  parameters,  k  is  assumed  to  be  a  consistent  measure 
of  time.  Also,  the  data  points  used  in  the  estimating  equa¬ 
tion  should  either  be  the  first  three  or  three  consistent 
groups  with  the  same  number  of  data  points  in  each  group.  . 

Example.  Suppose  a  missile  development  program  con¬ 
sists  of  testing  10  missiles  at  each  stage  for  10  stages. 
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The  desired  reliability  at  the  end  of  the  program  is  90  per¬ 
cent  successes.  The  first  three  stages  resulted  in  two, 
six,  and  seven  successes  respectively.  Management  wants  to 
know  if  the  present  development  will  result  in  a  90  percent 
success  ratio  at  the  end  of  the  program  based  on  the  results 
of  the  first  three  stages. 

In  this  case,  R^  ■  2/10  -  .2,  R2  -  6/10  -  .6,  and 
Rj  ■  7/10  *  .7,  which  are  the  estimated  reliability  levels 
of  the  first  three  stages  based  on  the  results  of  the  test. 
Using  Eqs  (3.64),  (3.65),  and  (3.66),  the  parameters  are 
estimated  as 


-  .25 


.6  -  .2 

T  -“.  2? 


(3.67) 

(3.68) 


R„  •  R1  ♦  Q  •  .2  ♦  .53  »  .73 


(3.69) 


The  answer  to  the  question  posed  by  the  aumagement 
is  clear  before  actually  calculating  R1Q,  because  Ro  is  the 
highest  reliability  that  can  be  hoped  for  in  the  present 
program.  Kowever,  Rlfl  can  be  easily  calculated  by  substi¬ 
tuting  in  the  appropriate  values.  Thus, 

R10  •  .73  -  »53(.2S)10  -  .729  (3.70) 


which  is  short  of  the  reliability  goal.  Of  course,  manage¬ 
ment  can  now  change  the  development  program  and  start  the 
estimation  all  over  again  (Ref  10:181-183). 
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Other  Models 


The  Weiss  Model.  Herbert  K.  Weiss,  of  Northrup 
Aircraft,  Inc.,  stated  that  many  complex  systems,  especially 
those  involving  numerous  electronic  components,  are  subject 
to  failures  with  operating  time  that  follow  a  Poisson- type 
distribution  (Ref  57:532).  Assuming  the  mean  time  to 
failurr  (MTTF)  changes  by  a  constant  percentage,  the  model 
has  the  form 

T(i)  •  Aeci  (3.71) 

where  T(i)  is  the  (MTTF)  for  the  i**1  trial  or  stage,  and  A 
and  c  are  parameters  to  be  estimated. 

The  assumptions  for  using  the  model  are,  first,  a 
simple  system  is  assumed  where  the  MTTF  is  believed  to 
change  at  a  rate  that  is  unknown  on  successive  trials.  In 
addition,  failures  are  assumed  to  occur  according  to  a 
Poisson  process.  Lastly,  a  series  of  trials  are  assumed 
with  the  time  to  failure  on  each  trial  being  recorded. 

Weiss  develops  estimates  for  A  and  c  by  the  method 
of  maximum  likelihood.  The  ML  estimators  must  be  computed 
in  an  iterative  process  where  an  initial  value  is  assumed 
for  c,  and  then  two  values  for  A  are  computed  from  the  ML 
equations.  The  process  is  repeated  until  the  two  values 
calculated  for  A  are  equal  (within  a  specified  tolerance) . 

A  nice  characteristic  of  this  model  is  the  ability 
to  include  other  functions  for  T(i).  For  example,  it  can 
be  simplified  to  T(i)  •  A  if  there  is.  no  chsnge  in  the  MTTF 
with  each  successive  trial  number. 
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The  Wolman  Model.  W.W.  Wolman  considered  a  model 
which  takes  into  account  three  distinct  outcomes  of  an 
experiment* -success,  inherent  failure,  or  assignable  cause 
failure  (Ref  59:144*1^0).  Inherent  failures  are  considered 
random,  while  assignable  cause  failures  arc  those  that  are 
attributed  to  a  design  weakness  or,  therefore,  correctable. 
Wolman  uses  a  Markov* chain  approach  to  derive  the  model. 

The  Wolman  model  suffers  from  three  weaknesses. 
First,  it  requires  that  the  number  of  assignable  cause  fail 
ures  be  known  in  advance.  Second,  Wolman  has  no  procedure 
defined  for  estimation  of  parameters  in  the  model.  Finally 
it  lacks  the  ability  to  make  projection  about  future  reli* 
ability  (Ref  9:41-42). 

Sari ow  and  Scheuer  Model.  Richard  E.  Barlow  and 
Ernest  M.  Schsuer,  of  the  University  of  California  at 
Berkeley  and  the  Rand  Corporation,  also  considered  a  trino¬ 
mial  reliability  growth  model  (success,  inherent  failure, 
and  assignable  cause  failure,  as  with  the  Wolman  model) 

(Ref  5:53*60).  Unlike  Wolman's  probabilistic  model,  theirs 
is  a  nonparamecric- statistical  model.  As  with  the  Wolman 

model,  inherent  failures  are  defined  as  those  associated 

'  | 

with  a  system  at  the  state-of-the-art.  Assignable  cause 
failures  are  those  which  can  be  corrected  by  equipment  or 
operational  modifications.  The  reliability  of  the  system 
at  the  I***  stage  is  defined  as  t 


where  qQ  is  the  probability  of  an  inherent  failure,  and 
is  the  probability  of  an  assignable  cause  failure  at  the  ith 
stage.  The  parameters  qo  and  q^  are  estimated  by  the  method 
of  maximum  likelihood  (ML) . 

The  assumptions  of  the  Barlow-Scheuer  model  are  that 
there  will  be  k  stages  of  testing.  At  each  stage,  a  certain 
number  of  test  trials  are  conducted  which  may  be  fixed  in 
advance  or  randomly.  The  results  of  the  tests  from  one  stage 
are  used  to  make  improvements  to  the  system  at  future  stages. 
In  addition,  any  changes  that  are  made  to  the  system  are 
assumed  to  increase  the  reliability  of  the  system.  One  of 
the  problems  with  the  model  is  that  Barlow  and  Scheuer  pro¬ 
vide  no  functional  relationship  for  the  reliability  growth 
process.  This  means  it  is  not  possible  to  make  reliability 
projections  (Ref  9:40). 

The  Gross  and  Kamins  Models.  Gross  and  Kamins,  of 
the  Rand  Corporation,  investigated  four  generalized  reliabi¬ 
lity  growth  models  (Ref  27:406-416).  One  of  the  models  was 
a  generalized  form  of  the  Lloyd  and  Lipow  model.  The  other 
models  were  variations  of  a  model  very  much  like  Lloyd  and 
Lipow' s.  None  of  the  models  emerged  as  a  clear  choice,  and 
Gross  and  Kamins  suggested  that  yet  another  variation,  an 
"adaptive  model,"  would  yield  good  results  (Ref  4:18). 

Gross  and  Kamins  present  several  tables  and  graphs 
which  show,  in  a  comparative  way,  the  results  of  their 
efforts.  In  addition,  their  concluding  remarks  point  out 
the  significant  results  of  the  research  in  a  list  of  nine 
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points. 


The  Pollock  Model  (Bayesian) .  Stephen  M.  Pollock 
introduced  a  reliability  growth  model  that,  incorporates  the 
Bayesian  concept  of  prior  information  (Ref  49:187*198). 
Pollock's  main  objectives  were  to  gain  inference  on  estima* 
tion  (the  present  value  of  reliability)  and  projection  fthe 
reliability  at  some  future  time) ,  with  or  without  continued 
application  of  the  correction  or  growth  processes  (Ref  S8: 
472-475).  In  addition,  he  includes  both  continuous  and 
discrete  cases. 

Pollock  provides  a  detailed  discussion  and  rigorous 
mathematical  presentation  of  Bayesian  methods  and  how  they 
apply  to  reliability  growth.  He  has  even  taken  into  account 
the  notion  that  reliability  may  decrease  rather  than  in¬ 
crease  as  the  development  process  is  administered  (Ref  4:50). 
The  modeling  technique  presented  by  Pollock  appears  to  have 
good  monitoring  potential  and  also  good  projection  capability. 

The  Singpurwalla  Time  Series  Method.  Noser  D. 
Singpurwalla,  of  GeoTge  Washington  University,  has  done  work 
in  reliability  using  time  series  analysis  techniques.  la 
1975,  he  proposed  a  method  for  forecasting  reliability  growth 
or  deterioration  based  on  a  time  series  analysis  approach 
(Ref  53:1-14).  He  placed  particular  emphasis  on  the  fact 
that  the  time  series  process  he  discusses  will  measure  both 
an  increase  and  a  decrease  in  failure  rate. 

The  assumptions  of  the  model  are,  first,  outcomes 
of  each  test  are  determined  to  be  either  successes  or 
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failures.  In  other  words,  at  the  end  of  the  jth  stage, 

independent  tests  have  been  completed  with  r.  successes. 

* 

If  Pj  denotes  the  reliability  at  the  end  of  the  j  stage, 
then  r^  is  binomially  distributed  with  parameters  and  P^. 

Singpurwalla  offers  two  techniques  for  directly  esti¬ 
mating  the  parameters  Nj  and  P  ^ .  First,  he  discusses  the 
method  of  maximum  likelihood.  Then,  because  it  is  often 
desirable  to  modify  estimators  based  on  prior  information, 
he  suggests  using  Bayesian  estimators.  In  addition,  he  pro¬ 
vides  a  discussion  on  how  to  work  with  transformations  of 
the  estimators. 


The  time  series  analysis  Singpurwalla  suggests  using 
is  the  Box  and  Jenkins  method  (Ref  11).  This  is  an  autoregres¬ 
sive  integrated  moving  average  (ARIMA)  model,  and  the  tech¬ 
nique  is  to  model  the  data  and  then  analyze  the  residuals. 

The  determination  of  a  positive  trend  term  would  imply 
reliability  growth  is  present,  while  a  negative  trend  term 
would  indicate  deterioration  of  reliability. 

Singpurwalla  emphasizes  two  advantages  to  his 
approach.  First,  his  method  does  not  require  a  particular 
reliability  growth  model  be  specified.  This  implies  more 
flexibility  for  the  analyst.  Next,  the  method  allows  the 
analyst  to  incorporate  deterministic  inputs  such  as  engineer¬ 
ing  judgments  or  managerial  interventions  (Ref  53:2). 

A  disadvantage  to  the  approach  is  that  it  requires 
data  in  a  large  number  of  stages.  This  is  necessary  so 
trends  in  the  residuals  can  be  determined. 
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IV.  Dormancy  and  Dormant  Reliability 


Almost  any  system  conceived  will  spend  a  portion  of 
its  life  in  a  non-operating  state.  In  a  non-operating  state, 
the  electrical  or  mechanical  stresses  normally  associated 
with  an  activated  state  are  not  present,  but  this  does  not 
mean  that  all  stresses  to  the  system  are  absent  (Ref  32:16). 
Other  stresses  may  be  at  work--the  environment,  transporta¬ 
tion,  or  handling,  to  name  a  few. 

Reliability,  of  course,  is  state  dependent.  If  the 
true  reliability  of  a  system  is  to  be  known,  the  nature  of 
each  state  of  the  system  must  be  taken  into  account.  However, 
this  has  not  always  been  done  in  the  past.  For  example, 

Rocco  F.  Ficchi,  an  engineer  for  Radio  Corporation  of 
America,  stated: 

It  is  generally  assumed  that  parts  and  equipment 
subject  to  zero  electrical  stress  had  zero  fail¬ 
ures.  This  has  been  shown  to  be  untrue  [Ref  24: 

42]. 

Engineers  now  realize  that  reliability  in  a  non-operating 
state  is  very  important.  For  example,  certain  of  our  stra¬ 
tegic  weapon  systems  (Minuteman  missile  system,  for  one) 
spend  all  their  life  in  non-operating  states.  In  addition, 
new  weapon  systems,  like  the  cruise  missile,  are  being  built 
which  will  spend  most  of  their  life  in  a  non-operating  con¬ 
dition  (Ref  32:7).  This  has  led  to  an  increasing  interest 
in  the  reliability  of  non-operating  systems  (Ref  32:11). 


Definitions 


Non-operating  State.  A  non-operating  state  is  actu¬ 
ally  a  set  of  states  that  can  be  divided  into  several  subsets. 
Examples  of  these  subsets  are:  storage,  inherent  dormancy 
(totally  non-operating  but  not  in  storage),  and  operationally 
ready  storage  (awaiting  operational  use  with  some  subsystems 
energized)  (Ref  32:17).  However,  in  this  study  it  is  not 
purposeful  to  differentiate  between  the  different  non¬ 
operating  states.  Therefore,  terminology  which  has  been  more 
precisely  defined  elsewhere  will  not  be  used  here.  Instead, 
the  following  definitions  will  be  used  to  refer  to  a  general 
non-operating  state. 

Dormancy.  This  is  a  state  where  a  system  experiences 
either  no  operational  stress,  or  very  low  levels  of  opera¬ 
tional  stress  (Ref  24:25).  Dormancy  can  include  such  states 
as  non-operating  portions  of  alert,  transportation  and 
handling,  and  launcher  carriage  as  examples  (Ref  32:18). 

Dormant  Reliability.  Reliability  is  defined  as  the 
probability  that  failure  does  not  occur  before  a  specified 
time  (see  Eq  2.2).  Cdnsistent  with  this  definition,  dormant 
reliability  will  be  referred  to  as  the  probability  that  a 
system  in  a  dormant  state  does  not  fail  prior  to  a  specified 
time.  In  other  words,  dormant  reliability  is  the  reliability 
of  a  system  in  a  dormant  state. 

Methods  of  Analysis 

Dormant  reliability  analysis  has  been  identified  as 
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falling  into  three  broad  categories  (Ref  32:27).  These 
categories  are:  1)  parts  count  and  stress  analysis;  2) 
failure  rate  modification  factors  (K  factors) ;  and  3)  test¬ 
ing  (accelerated  and  field  testing) .  Each  of  these  methods 
have  good  and  bad  points,  which  helps  indicate  which  to  use 
in  a  given  situation.  In  the  following  paragraphs,  each 
method  will  be  briefly  described  stressing  important  points 
of  each  method. 

Parts  Count  and  Stress  Analysis  Method.  This  tech¬ 
nique  assumes  that  system  reliability  can  be  calculated  if 
the  reliabilities  of  each  component  are  known  (Ref  32:27). 
The  failure  rates  of  each  component  are  determined  and  then 
summed  together  to  get  the  system  failure  rate.  The 
ponent  failure  rates  are  often  obtained  from  tables  like 
the  MIL-HDBK-217C.  These  tables  are  the  results  of  both 
empirical  data  and  laboratory  testing  on  previous  equipment 
(Ref  39). 

This  method  has  been  used  extensively  in  the  design 
phase  of  systems  or  subsystems  (Ref  32:27).  It  is  parti¬ 
cularly  useful  as  a  comparative  evaluation,  but  it  has  not 
been  conclusively  checked  against  empirical  data  from  dor¬ 
mant  systems.  For  this  reason,  it  is  not  likely  that  the 
operational  analyst  would  use  this  procedure  for  dormant 
reliability  prediction  (Ref  32:27). 

Failure  Rate  Modification  Factors.  Adjustments  to 
failure  rates  which  account  for  varying  stresses,  like  the 
environment,  are  generally  called  K  factors  (Ref  32:28). 
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The  idea  of  K  factors  is  to  modify  the  failure  rate  of  a 
system  to  achieve  more  accurate  predictions.  K  factors  are 
usually  developed  from  field  data  or  laboratory  testing  with 
systems  or  components  (Ro£  32:28-29). 

It  is  important  to  stress  that  K  factors  must  be 
used  with  caution.  Unless  specifically  validated  against 
empirical  results,  K  factors  could  simply  be  wrong.  However, 
they  have  been  used  with  good  results  ir  certain  situations 
(Ref  32:60). 

Testing.  Testing  is  probably  the  most  desirable 
method  of  analyzing  dormant  reliability,  however,  it  is  also 
the  most  expensive.  The  two  factors  that  are  primary  consi¬ 
derations  in  any  testing  program  are  sample  size  and  time 
(Ref  32:30).  Of  course,  both  of  these  factors  can  be  measured 
in  dollars.  Many  times,  a  limited  budget  makes  it  impossible 
to  use  testing  to  analyze  a  dormant  system. 

Testing  may  be  done  in  either  real  time  or  in  an 
accelerated  way  (Ref  32:30).  Accelerated  testing  can  be 
used  if  the  predominant  failure  mode  is  known.  For  example, 

if  seasonal  humidity  cycles  (changes  in  relative  humidity 

i 

with  the  seisons)  are  known  to  causa  a  seal  to  fail  in  a 
hydraulic  system,  then  the  humidity  cycles  can  be  accelerated 
in  the  laboratory  to  simulate  real  time  data.  This  has  been 
shown  to  be  a.  very  effective  way  of  determining  failure  rates 
(Ref  32:31).  However,  it  i.*  important  to  remember  that  it 
is  not  exactly  the  same  as  real  time  data.  There  could  be 
unforeseen  failure  mechanisms  that  would  not  show  up  i<.  the 


accelerated  test  data.  For  this  i jason ,  accelerated  test 
data  should  be  taken  in  the  proper  context. 

Real  time  testing  or  surveillance  testing,  or  the 
other  hand,  uses  data  gathered  from  actual  environmental 
conditions  (Ref  32:32).  Given  the  time  and  the  appropriate 
sample  size,  this  method  can  be  a  very  accurate  way  to 
determine  dormant  reliability.  However,  the  failure  mechan¬ 
isms  in  dormant  systems  are  often  very  slow  to  surface. 

For  instance,  it  could  take  years  of  dormancy  before  a  de¬ 
crease  in  reliability  of  an  electronic  circuit  would  be 
noticed  (Ref  21:14).  For  this  reason  surveillance  testing 
is  not  always  practical  (Ref  32:33).  Also,  it  is  generally 
very  expensive  to  administer  a  surveillance  test  which  is 
another  reason  why  other  methods  of  testing  are  often  chosen. 

Dormancy  Modeling 

Dormant  systems  are  generally  characterized  by 
changing  failure  rates  that  are  increasing  over  time.  The 
problem  with  modeling  most  dormant  systems  is  usually  due 
to  the  slow  rate  at  which  failures  occur.  The  failure  rate 
may  change  only  minutely  in  the  first  several  years  of  an 
equipment's  life.  The  variance  in  a  set  of  data  is,  at 
times,  large  enough  to  completely  mask  dormant  reliability. 
For  example,  Dickhaut  and  Dudley  did  a  study  of  the  long¬ 
term  storage  of  microelectronic  components,  and  were 
completely  unable  to  make  predictions  based  on  data  that 
were  available  (Ref  21:40-44).  The  problems  encountered  in 
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the  study  vert  typified  by  data  with  too  auch  variability 
to  provide  statistical  trends.  Iu  addition  to  very  slow 
changes  in  failure  rates,  dormant  systeas  also  have  quite 
small  initial  failure  rates  in  man/  cases.  Failure  rates 
of  r.icroeiectronic  devices,  for  example,  can  be  as  low  as 
1  x  Id*9  units  (Ref  8:3-5  to  3-324).  Again,  this  means 
variability  in  measurements  can  bo  a  problem  when  analyzing 
data.  Even  though  problems  with  dormant  data  exist,  attempts 
have  been  made  to  model  dormant  systems,  particularly  during 
the  design  phase. 

Dormant  reliability  modeling  in  the  past  has  been 
done  most  often  in  conjunction  with  life-cycle  modeling  in 
the  design  phase  of  systems  (Refs  1;  7;  8;  20;  21;  23;  34; 
3S).  Life-cyclo  modeling  takes  into  account  the  reliability 
of  each  phase  of  a  system's  life  (Ref  32:C-1).  Dormancy, 
under  this  concept,  consists  of  periods  of  time  in  the  life 
of  a  system  where  the  system  is  in  a  dormant  state.  The 
failure  rate  modification  method  is  used  to  determine  a 
failure  rate  for  the  specified  time  period  and  the  environ¬ 
mental  conditions  that  are  assumed  for  that  time  period. 

This  failure  rate  is  then  used  as  the  parameter  in  the  nega¬ 
tive  exponential  model  and  the  reliability  can  be  calculated. 
This  technique  is  used  under  the  concept  of  -'periodic 
testing"  or  "no  testing"  (Ref  32:C-2).  Under  the  "periodic 
testing"  concept,  the  system  is  tested  at  certain  intervals, 
and  if  necessary,  repaired.  This  brings  the  reliability 
level  back  to  the  original  level  or  very  nearly  so.  It 


X 


45 


should  be  noted  that  no  evidence  was  found  (in  the  fora  of 
technical  reports)  of  this  technique  being  validated  with 
enpirical  data. 

The  literature  search  on  doxaant  reliability  pro¬ 
duced  no  widely  accepted  aodeling  techniques  on  operational 
systems.  Reasons  for  this  have  not  been  specifically 

I 

defined.  However,  one  could  speculate  that  the  cost  of 
gathering  enpirical  'Uta  has  been  judged  to  outweigh  the 
information  received  from  the  data.  Also,  the  military  may 
be  one  of  only  a  few  organizations  with  a  real  concern  about 
dormant  reliability.  After  all,  private  sector  businesses 
are  generally  concerned  with  producing  and  selling,  not 
with  stov>ng. 
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V.  The  Monte  Carlo  Experiments 


The  fact  that  both  reliability  growth  and  dormant 
reliability  are  characterized  by  changing  failure  rates 
was  the  motivation  for  the  Monte  Carlo  experiments.  Certain 
reliability  growth  models  use  the  method  of  fitting  a  curve 
to  a  set  of  data.  From  the  curves*  which  smooth  the  date* 
reliability  estimations  can  be  inferred.  Some  reliability 
growth  models  are  capable  of  modeling  data  that  has  either 
a  decreasing  failure  rate  (reliability  growth)  or  an  increas- 

! 

ing  failure  rate  (as  with  dormant  reliability) .  With  some 
models*  the  original  assumptions  may  have  to  be  changed  to 

i 

handle  increasing  failure  rates*  but  this  problem  can 
usually  be  overcome.  For  example*  the  parameter  (a)  in  the 

i 

Duane  model  is  assumed  to  be  between  zero  and  one  if  reli> 

» 

i 

ability  growth  is  present.  However*  by  changing  this 
assumption  and  allowing  a  to  take  on  values  greater  than  ; 
one*  an  increasing  failure  rate  can  be  modeled.  Therefore*  i 

models  like  the  Duane  can  be  considered  candidates  for  1 

"  .  -  '"07* •  i 

dormant  reliability  modeling. 

The  purpose  of  the  Monte  Carlo  experiments  was  to 
observe  results  of  modeling  attempts*  i.e.  modeling  dormant  j 
data  with  reliability  growth  models.  The  results  are 

i 

important  because  they  potentially  provide  a  new  methodology 
for  analysts  who  work  with  dormant  data.  There  is  already 
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*  good  variety  of  reliability  growth  models  in  existence* 
and  the  methodology  behind  most  of  them  is  well  developed. 

Any  evidence  that  shows  reliability  growth  models  to  be  use¬ 
ful  in  modeling  dormancy  would  provide  alternative  methodo¬ 
logies  to  solve  the  problem. 

Monte  Carlo  techniques  were  chosen  to  generate  data 
for  the  experiments  for  two  reasons.  First*  no  data  from  a 
dormant  system  could  be  found  that  was  suitable  for  the 
experiments.  Only  one  good  set  of  data  was  obtained.  This 
data  was  the  result  of  field  tests  in  the  AGM  65  A/B 
(Maverick)  missile  system.  The  problem  with  the  data  was 
that  it  showed  too  small  an  increase  in  the  failure  rate  to 
be  useful  in  a  comparative  analysis  and*  therefore*  was  not 
used. 

The  second  and  most  important  reason  Monte  Carlo 
methods  were  used  was  to  have  control  over  the  underlying 
failure  distributions  of  the  system.  Since  the  underlying 
distributions  were  known*  the  true  system  reliability  could 
be  calculated  and  used  as  a  comparative  basis  for  the 
Hgoodness-of-fit"  measures.  In  addition,  the  underlying 
distribution  can  be  easily  changed  for  future  experimentation. 

Models  Tested 

Three  reliability  growth  models  were  selected  for 
the  experiments.  They  are  the  Gompertz  model,  the  Bonis 
model,  and  the  Duane  model.  There  were  three  primary  fac¬ 
ers  considered  in  the  selection  of  these  models.  First, 
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any  model  chosen  had  to  have  the  ability  to  predict  future 
reliability  (this  is  an  extrapolation  of  the  estimated 
function).  All  three  models  met  this  requirement.  Second, 
the  underlying  assumption  in  the  models  chosen  had  to  be 
such  that  dormant  data  could  be  modeled.  Again,  the  three 
models  chosen  met  the  requirement.  Lastly,  because  computer 
time  was  a  constraint,  it  was  desirable  to  select  models  in 
which  the  parameters  were  relatively  easy  to  calculate.  The 
design  of  the  simulation  called  for  the  parameters  to  be 
estimated  1200  times  for  each  model.  Therefore,  models  that 
require  iterative  parameter  estimation  techniques  were  ruled 
out.  An  additional  factor  that  was  considered  was  the  popu¬ 
larity  of  the  models  in  the  military.  These  three  models 
have  been  used  extensively  in  military  programs,  particularly 
the  Duane  model.  For  these  reasons,  it  was  decided  that,  the 
three  models  chosen  would  represent  a  good  set  for  initial 
experimentation. 

The  Gomoertz  Model.  This  model  has  three  parameters 
which  are  estimated  from  explicit  equations  using  time 
dependent  data.  Mathematically,  this  model  is  represented  by 

ct 

R(t)  -  abc  (5.1) 

This  same  form  was  used  to  model  the  dormant  data  with  one 
exception.  The  parameter  a  is  defined  as  the  upper  value  of 
reliability  of  a  system  (see  the  discussion  of  this  model  in 
Chapter  III).  In  the  simulation,  the  assumption  was  made 
that  all  systems  that  wore  placed  in  storage  at  the  beginning 
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of  the  testing  program  were  nonfailed  (good  systems) .  Since 
parameter  a  represents  the  highest  attainable  reliability, 
this  implies  that  a  ■  1,  and  the  functional  form  of  the 
model  reduces  to 

c t 

R(t)  -  bc  (S.2) 

where 

R(t)  *  the  probability  the  system  will  be  a 
success  at  time  t 

b  »  the  base  parameter 

c  ■  the  shape  parameter 

t  *  time 

The  parameters  b  and  c  were  estimated  using  Eqs 
(3.49)  and  (3.43)  respectively.  To  make  Eq  (S.2)  a  valid 
measure  of 'reliability,  the  parameter  b  must  be  restricted 
to  values  between  zero  and  one.  Also,  if  an  increasing 
failure  rate  is  assumed,  c  must  be  strictly  greater  than  one. 
If  these  conditions  were  not  met  in  the  simulation,  the  model 
was  considered  invalid.  The  primary  cause  of  not  meeting 
the  restrictions  was  not  enough  consistent  data. 

The  Bonis  Model.  Assumptions  concerning  the  data 
when  using  the  Bonis  model  are  similar  to  those  when  using 
the  Gompertz  model.  The  data  must  be  used  in  three  conse> 
cutive  groups  (see  the  discussion  on  the  Bonis  model  in 
Chapter  III).  The  form  of  the  Bonis  model  is 

Rk  -  R„  -  QB*'1  (5.3) 
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R^  represents  the  upper  limit  of  reliability  as  k  is  increased 
without  bound  (3ee  the  discussion  of  this  model  in  Chapter 
III).  This  parameter  is  very  similar  to  the  parameter  a  in 
the  Gompertz  equation.  Also  like  a  in  the  Gompertz  equation, 
Rw  is  assumed  to  be  one,  because  all  nonfailed  systems  are 
assumed  at  the  start  of  the  test  program. 

The  other  two  parameters,  B  and  Q,  are  estimated  with 
Eqs  (3.64)  and  (3.65)  respectively.  Since  Q  is  defined  as 
the  initial  unreliability,  its  value  was  restricted  to  bet¬ 
ween  zero  and  one.  In  addition,  B  must  be  strictly  greater 
than  one  if  an  increasing  failure  rate  is  to  be  represented. 
Once  again,  if  these  assumptions  were  not  met,  the  model  was 
considered  invalid. 

A  particular  problem  with  the  Bonis  model  is  that  it 
has  no  Inflection  point,  and  will  decrease  without  bound 
when  used  to  model  dormant  data.  In  other  words,  once  the 
reliability  starts  a  downward  trend,  it  continues  downward 
without:  bound  as  k  is  increased.  Extrapolated  values  for 
reliability  obtained  from  this  model  are  invalid  after  a 
certain  point.  However,  there  is  still  a  rationale  for 
using  the  model.  For  instance,  many  times  an  analyst  may 
be  interested  in  finding  the  time  (k)  where  the  reliability 
level  of  interest  is  relatively  high  (generally  above  the 
inflection  point  in  the  true  reliability  curve) ;  the  Bonis 
model  should  provide  acceptable  results. 

The  Duane  Model.  The  Duane  model  uses  two  methods 
of  parameter  estimation- -the  graphical  technique  and  least 
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squares  estimators.  The  least  squares  estimators  are  a 
mathematical  representation  of  the  graphical  technique. 
Therefore,  least  squares  was  chosen  to  estimate  the  para¬ 
meters.  The  Duane  mochl  is  given  as 

N(t)  -  Kt1*®  (5.4) 

where 

N(t)  »  the  cumulative  number  of  failures 

a  -  the  decreasing  reliability  rate  constant 

K  ■  a  constant  that  represents  the  cumulative 
failure  rate  at  t  »  0 

t  -  time 

Dividing  Eq  (5.4)  by  t  and  taking  logarithms  gives  Eq  (3.4), 

which  is  used  to  estimate  the  parameters  a  and  K. 

Once  the  two  parameters  have  been  estimated,  they 

are  used  in  Eq  (3.3)  to  obtain  instantaneous  failure  rates 

•  * 

for  values  t.  The  instantaneous  failure  rates  are  trans¬ 
formed  into  reliabilities  using  the  negative  exponential  model. 

The  rationale  for  using  the  Duane  model  is  that  with 
reliability  growth,  the  cumulative  failure  rate  was  a  de¬ 
creasing  function  of  time.  With  dormant  reliability,  the 
opposite  occurs;  the  cumulative  failure  rate* increases  with 
time. 

Simulation  Methodology 

The  methodology  was  to  use  Monte  Carlo  'techniques  to 
generate  sets  of  dormant  data  which  were  subsequently  modeled 
with  reliability  growth  models.  After  the  v  ta  were  modeled 
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(parameters  estimated) ,  reliabilities  were  estimated  using 
the  functional  relationships  associated  with  each  model. 

The  estimated  reliabilities  were  then  compared  with  thi  true 
reliabilities  based  on  the  underlying  failure  distributions 
which  were  used  to  generate  the  data.  The  result  was  a  set 
of  relative  measures  (which  can  be  thought  of  as  relative 
goodness-of-fit  measures)  of  the  model  against  the  true 
system  reliability. 

The  System.  In  order  to  add  a  sense  of  realism,  a 
fictitious  missile  system  was  contrived  which  will  be  re¬ 
ferred  to  as  hypothetical  missile  system  one  (HM-1).  The 
HM-1  consists  of  five  independent  subsystems  in  series: 

1)  the  propulsion  system;  2)  the  servo-mechanical  fin  actu¬ 
ator;  3)  the  arming  system;  4)  the  gyro;  and  5)  the  electro¬ 
nic  control  system.  Each  subsystem  has  a  separate  failure 
distribution  associated  with  it.  The iWelbull  failure  dis¬ 
tribution  ! 

i  ■ 

f(t)  -  2^—  EXP  -  ,  t  >  0  (5.5) 

was  assumed  to  be  the  underlying  distribution  in  each  sub¬ 
system  In  this  distribution,  B  is  the  shape  parameter 
(governs  the  shape  of  the  density  function),  and  6  is  the 
scale  parameter  (stretches  the  density  distribution  out) 

(Ref  30:22). 

The  five  subsystems  and  their  associated  parameter 
values  are  shown  in  Fig.  2.  Of  course,  the  knowledgeable 
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Fig  2.  The  HM-1 


reader  will  realize  that  the  five  separate  distributions 
could  have  been  combined  into  a  single  Weibull  failure  dis- 
tribution  because  the  shape  parameter,  3,  is  identical  for 
each  subsystem.  However,  the  computer  simulation  was 
written  with  the  intent  of  making  future  changes  to  the 
failure  distributions  of  the  subsystems.  Therefore,  even 
though  one  distribution  could  have  modeled  the  entire  system 
in  this  case,  separate  distributions  were  used  to  maintain 
generality. 

In  each  subsystem,  the  shape  parameter,  B,  was  given 
a  value  of  four.  Even  though  the  value  of  B  was  arbitrary, 
the  intent  was  to  closely  approximate  the  normal  distribu¬ 
tion  (Ref  30:294).  In  other  words,  it  was  assumed  that  the 
failures  of  each  subsystem  were  normally  distributed,  but 
were  approximated  by  the  Weibull  distribution  with  B  *  4. 

The  scale  parameters  were  contrived  so  the  system  would  de¬ 
crease  in  reliability  from  one  to  approximately  zero  as 
time  (t)  was  increased  from  zero  to  20.  The  reasoning 
behind  this  was  to  force  the  models  to  contend  with  a  full 
range  of  relitl  l' *  ties  and  see  how  well  the  predictions 
would  be  under  this  contention. 

Data  G^ner ution.  Monte  Carlo  techniques  were  used 

to  generate  data  for  the  modeling  experiments.  7ht  - _ -  were 

generated  as  either  a  missile  failure  or  success.  The  steps 
for  determining  the  successes  or  failures  in  a  set  of  data 
are  as  follows: 

1.  The  reliability  of  each  subsystem  was  calculated 


for  the  specified  value  of  time  (t) . 

2.  Generate  a  random  number  for  each  subsystem  and 
compare  it  with  the  subsystem's  reliability 
calculated  in  Step  1. 

3.  Since  the  subsystem  reliability  is  defined  as  the 
probability  of  a  success,  the  subsystem  was  con¬ 
sidered  a  success  if  the  random  number  was  less 
than  the  calculated  reliability. 

4.  Zach  subsystem  is  independent  and,  therefore,  all 
subsystems  must  be  successful  if  the  system  is  to 
be  a  success. 

5.  Repeat  steps  two  through  four  until  the  desired 
number  of  missiles  per  time  period  have  been 
tested. 

6.  Increment  t,  where  t  *  1,2,3,. .. ,12,  and  repeat 
the  process  until  the  desired  number  of  years 
of  data  have  been  generated. 

The  computer  used  for  the  simulation  was  an  Apple  II 
microcomputer.  The  internal  pseudorandom  number  generator, 
END(  ),  was  used  to  generate  the  random  numbers.  The  vali¬ 
dity  of  the  random  numbers  was  checked  with  two  separate 
serial  tests  (Ref  41:57-59)  done  on  two  separate  random 
number  streams  of  100,000  random  numbers  each.  In  each 
serial  test,  100  chi-square  statistics  from  a  frequency  test 
were  used  as  input  to  another  chi-square  test  (Ref  41:57). 
The  results  were  values  of  5.600  and  6.600  for  the  chi- 
square  statistics  compared  w)th  a  critical  value  of  14.684 


at  a  *  .10  level  of  significance.  It  was  concluded  that 
RND(  )  was  a  satisfactory  pseudorandom  number  generator  for 
the  experiments. 

The  Testing  Procedure.  In  the  simulation,  the  test¬ 
ing  schedule  was  varied  with  the  intent  of  finding  which 
model  would  work  best  in  a  given  situation.  Also,  it  was 
hoped  to  gain  an  insight  into  how  much  data  were  needed 
for  one  model  relative  to  another. 

The  first  assumption  is  that  a  large  amount  of  HM-1 
mis.iiles  were  produced  and  placed  in  storage  at  t  *  0. 

Each  time  period  (which  could  be  thought  of  as  years) ,  a 
specified  number  of  missiles  are  brought  out  of  storage  and 
tested.  For  example,  m  the  first  simulation  run  50  missiles 
per  time  period  were  brought  out  of  storage  and  tested.  This 
was  the  first  testing  policy  used  with  each  model. 

After  six  time  periods  of  testing,  the  data  were 
modeled  and  the  reliabilities,  R(t),  for  t  *  1,2, 3,..., 20 
were  estimated.  This  is  considered  one  set  of  reli-bili* 
ties  (which  can  be  thought  of  as  one  dormant  reliability 
curve)  based  on  one  set  of  random  numbers.  This  process  was 
repeated  SO  times  using  different  random  numbers  each  time. I 
The  result  was  a  set  of  reliabilities  R^(t)  where  i  ■ 

1,2, 3,. ..,50  and  t  -  1,2,3,. ..  ,20.  Using  the  central  limit  , 
theorem  (Ref  37:252),  the  mean  and  variance  for  the  R^(t)'s 
were  calculated  for  t  ■  1,2,5,...,  20  where  the  mean  is 
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(5.6) 


,  50 

K(t)  -  tx  Z  Ri (t) 

50  i-1  1 

and  the  sample  variance  is 

SO  , 

I  (RjCt)  -  K(t)]z 

S(t)  -  ^ - Sr1 -  (£.7) 

The  mean,  K(t),  was  the  dormant  reliability  curve  that  was 
used  for  the  comparison  with  the  true  system  reliability 
curve.  This  will  be  discussed  in  further  detail  later. 

The  next  logical  step  was  to  add  more  data.  This 
was  first  done  by  leaving  the  same  test  program  in  effect 
(SO  missiles  per  time  period  tested),  but  instead  of  using 
only  six  time  periods  of  data,  nine  time  periods  of  data 
were  used.  Increments  of  three  time  periods  were  chosen  for 
increases  in  data  be'ause  the  Gompertz  and  Bonis  models  both 

require  data  in  three  equally- si zed  groups.  Finally,  12  time 

i 

periods  of  data  were  used  to  make  estimates  with  the  same 
test  program  in  effect.  This  resulted  in  three  sets  of 
K(t)*s  or  three  average  dormant  reliability  curves,  one  for 
six,  one  for  nine,  and  one  for  twelve  time  periods  of  data. 

The  preceding  procedure  was  considered  to  be  one 
simulation  run  based  on  one  test  program.  The  final  step 
was  to  change  the  test  program  from  SO  missiles  per  time 
period  tested  to  100  missiles  per  time  period  tested  in 
increments  of  10.  This  meant  that  six  different  simulation 
runs  were  made  on  each  model  with  each  run  using  a  different 
tost  program.  The  idea  was  to  start  with  a  minimal  amount 
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of  data,  increase  it  by  increments,  and  observe  the  behavior 
of  the  dormant  reliability  curves  as  more  data  were  used. 

Relative  Measures 

In  order  to  include  a  numerical  comparison  of  how 
well  each  model  did  under  a  given  test  program,  three  rela¬ 
tive  measures  were  used.  These  measures  (Ml,  M2,  and  M3) 
can  be  thought  of  as  relative  goodness-of-fit  measures  and 
are  similar  to  ones  used  by  Toke  Jayachandran  in  his  stu-ly 
on  reliability  growth  (Refs  28;  29). 

Measure  One  (Ml) .  This  measure  is  simply  the  sum 
of  the  discrepancy  between  the  true  reliabilities,  R*(t), 
and  the  average  reliabilities,  K(t) ,  for  a  given  test  pro¬ 
gram.  Mathematically,  the  measure  is 

20 

Ml  -  £  | R* ( t)  -  R(t)|  (5.8) 

t-1 

where  t  is  the  time  periods.  Ml  measures  the  total  distance 
the  average  reliability  curve  (E(t))  is  away  from  the  rue 
reliability  curve  (R*(t)]  at  each  of  the  20  time  periods. 

Measure  Two  (M2) .  This  measure  is  the  sum  of  the 
squared  values  of  Ml  at  each  of  the  20  time  periods.  This 
measure  is  closely  associated  with  the  sum  of  the  squared 
errors  which  is  used  in  regression  analysis.  The  fo«r*  of 
M2  is 

20  2 
M2  -  Z  (R*(t)  -  JT(t)]Z 

t-1 


(5.9) 


This  Measure  emphasizes  average  reliabilities  that  are 
grossly  different  from  true  liabilities. 

Measure  Three  (M3) .  M3  is  defined  as  the  maximum  of 
the  squared  different  j  between  the  true  reliabilities 
[R*(t)]  and  the  average  estimated  reliabilities  (K(t)].  The 
equation  for  M3  is 

M3  -  Max{[R*(t)  -  E(t)]2}  (5.10) 

t 

Each  of  these  three  measures  was  calculated  for 
each  average  dormant  reliability  curve  estimated  (!C(t)]. 

This  resulted  in  18  sets  of  measures,  one  set  for  the  test 
program  where  SO  missiles  per  time  period  were  tested  and 
six  time  periods  of  data  were  used,  another  set  for  SO 
missiles  per  time  period  tested  and  nine  time  periods  of 
data  used,  and  so  on.  The  number  of  missiles  tested  per 
time  period  ranged  from  SO  to  100  in  increments  of  10,  while 
the  number  of  time  periods  of  data  used  was  six,  nine,  or 
twelve.  Thus,  a  total  of  18  sets  of  relative  measures  were 
calculated. 
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VI.  Simulation  Results 

The  results  of  the  Monte  Carlo  experiments  were  not 
as  consistent  as  hoped  for.  That  is,  the  models  did  not 
behave  as  well  as  expected.  For  instance,  the  predictions 
from  both  the  Duane  and  Gompertz  models  were  further  from 
the  true  reliabilities  when  the  number  of  time  periods  of 
data  used  was  increased  from  9  to  12.  For  the  Duane  model, 
this  happened  only  when  90  or  100  missiles  per  period  were 
tested.  However,  this  phenomenon  took  place  in  every  case 
with  the  Gompert2  equation.  On  the  other  hand,  the  Bonis 
model  wi  generally  more  consistent.  However,  the  Bonis 
equation  generally  required  more  data  to  achieve  relative 
measures  that  were  as  good  as  either  the  Duane  or  Gompertz 
model.  Also  noted  was  the  fact  that  increasing  the  number 
of  missiles  tested  per  time  period  did  not  make  much  differ* 
ence  in  a  model's  ability  to  predict  future  reliability. 

On  the  other  hand,  increasing  the  number  of  time  periods  of 
data  used  to  estimate  parameters  made  the  reliability  pre¬ 
dictions  significantly  batter. 

The  results  of  the  simulation  are  shown  graphically 
in  Fig  3  through  Fig  20  at  the  end  of  the  chapter.  Also, 
the  relative  goodness -of- fit  measures  (Ml,  M2,  and  M3) 
follow  the  graphs  in  Tables  V  through  X. 
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Results  Using  the  Gompertz 
Equation 


The  most  notable  inconsistency  evident  £rom  the 
relative  measures  involves  the  Gompertz  equation.  The 
measures  indicate  better  results  when  nine  periods  of  data 
were  used  instead  of  12  with  every  test  policy.  In  other 
words ,  the  predictions  were  worse  when  more  data  were  used. 
The  reason  for  this  inconsistency  is  not  completely  under¬ 
stood.  However,  there  were  two  observations  noted  that 
help  explain  this  occurrence. 

First,  the  dormant  reliability  curves  generated  by 
the  Gompertz  equation  are  quite  sensitive  to  the  base  para¬ 
meter,  b,  from  Eq  (5.2)r'For  example,  with  the  shape  para¬ 
meter,  c,  set  equal  to  1.4  and  b  -  .99,  the  reliability  at 
10  time  periods,  R(10),  is  .75.  However,  when  b  was  changed 
by  ,\>S  to  .995,  R(10)  »  .87,  a  difference  of  .12.  This 
points  v«  fact  that  if  b  is  estimated  slightly  high, 

the  result  wi'  be  a  dormant  reliability  curve  that  over¬ 
estimates  the  true  .'liabilities  (shifted  to  the  right). 

From  the  graphs,  this  appears  to  be  the  case  with  the 
Get,  '}t*tion.  ‘ 

There  was  also  a  second  trend  noticed  with  the 
Gompertz  model.  The  shape  parameter,  c,  governs  the  rela¬ 
tive  steepness  of  the  reliability,  curves  at  the  inflection 

I 

point.  The  higher  the  value  of  cl  the  steeper  the  curve 
will  be.  Therefore,  if  the  base  parameter,  b,  is  estimated 
too  high,  the  scale  parameter,  c,  can  compensate  by  making 

02 


the  curve  steeper.  This  will  cause  the  predicted  reliabil¬ 
ity  curve  to  cross  or  at  least  converge  toward  the  true 
reliability  curve.  This  occurred  with  every  testing  policy 
when  nine  periods  of  data  were  used.  The  average  base  para¬ 
meter,  b,  was  always  the  greatest  when  nine  periods  of  data 
were  used  (.996  to  .998),  but  the  shape  parameter,  c,  always 
compensated  by  being  higher  when  nine  periods  of  data  were 
used  rather  than  12  (approximately  1.65  compared  to  1.45 
for  12  periods  of  data) .  The  reason  for  this  was  not  deter¬ 
mined,  but  it  resulted  in  better  predictions  when  nine 
periods  of  data  were  used  in  every  case. 

The  observations  made  on  the  Gompertz  model  can  be 
visualized  in  the  graphs  of  Fig  3  through  Fig  20.  It  should 
be  noted,  that  the  data  used  to  estimate  b  and  c  was  cumula¬ 
tive  in  nature.  This  was  according  to  the  example  suggested 
by  Virene  (Ref  56) .  This  means  the  percent  reliability 
levels  used  were  cumulated  percentages  of  all  the  data  from 
time  t  •  0. 

Results  Using  the  Bonis 
Equatio'n 

The  Bonis  model  was  generally  more  consistent  than 
either  the  Duane  or  Gompertz  models.  Under  every  testing 
policy,  the  relative  measures  improved  as  more  data  were 
made  available.  The  problem  with  the  Bonis  model  lies  in 
the  fact  that  more  data  were  needed  to  get  results  that 
compared  equally  with  the  Duane  and  Gompertz  models.  This 
was  due  in  part  to  the  fact  that  the  Bonis  model  does  not 
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have  an  inflection  point.  This  means  the  reliability  pre¬ 
dictions  decrease  without  bound  once  the  downward  trend  has 
started.  This  makes  the  model  unable  to  predict  reliabili¬ 
ties  in  the  right-hand  tail  of  the  reliability  curve.  This 
can  be  seen  in  Fig  3  through  20.  However,  the  reliability 
predictions  made  with  the  Bonis  model  appeared  to  be  accept¬ 
able  for  all  reliability  levels  prior  to  the  inflection 
point  of  the  true  reliability  curve.  In  many  cases,  the 
fit  of  the  Bonis  model  appears  closer  in  the  early  time 
periods  than  either  the  Duane  or  Gompertz  models. 

Results  Using  the  Duane  Model 

The  Duane  model  generally  required  more  data  than 
the  Gompertz  model,  but  less  than  the  Bonis  model,  to  get 
equal  results.  As  with  the  Gompertz  model,  however,  it  also 
was  inconsistent  in  some  cases.  For  example,  as  the  number 
of  missiles  tested  per  period  was  increased  from  70  to  100, 
the  relative  measures  increased  slightly,  indicating  the 
predictions  were  getting  worse.  This  occurred  only  when  12 
periods  of  data  were  used  to  estimate  the  parameters.  Also, 
the  measures  increased  when  the  time  periods  of  data  were 
increased  from  nine  to  12.  However,  this  was  only  the  case 
when  90  or  100  missiles  per  period  were  tested. 

Like  the  Gompertz  model,  the  reason  the  predictions 
of  the  Duane  model  were  getting  worse  appeared  to  be  a  shift 

in  the  predicted  reliability  curve.  Unlike  the  Gompertz 

# 

model,  however,  the  Duane  curves  shifted  to  the  left  rather 
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than  to  the  right.  One  reason  for  this  shift  may  be  in  the 
way  the  parameters  are  estimated.  From  Eq  (3.4),  it  is  ob¬ 
vious  that  the  dependent  variable,  ln[N(t)/t],  is  undefined 
when  N(t)  (cumulative  number  of  failures)  is  zero.  This 
means  that  until  a  failure  occurs,  data  points  cannot  be  in¬ 
cluded  in  the  regression  equation.  During  the  simulation, 
the  system  reliability  was  high  enough  in  its  early  life  to 
cause  no  failures  in  time  periods  one  through  three.  At 
times,  there  would  be  no  failures  until  as  many  as  five  or 
six  time  periods.  Of  course,  the  fact  that  no  failures  take 
place  early  in  the  system's  life  is  taken  into  account  in 
some  respect  by  the  cumulation  of  data.  However,  it  must  be 
re-emphasized  that  once  a  change  in  the  failure  rate  is  esti¬ 
mated  with  the  Duane  model,  the  change  is  assumed  to  be  con¬ 
sistent  throughout  the  extrapolation.  For  example,  if  there 
are  no  failures  for  the  first  three  time  periods  and  nine 
time  periods  of  data  are  used  to  estimate  the  parameters, 
then  the  last  six  time  periods  are  used  to  model  the  changing 
failure  rate  of  the  system.  The  model  is  then  extrapolated 
back  to  t  -  1  as  well  as  forward  to  t  ■  20.  The  problem  is 
that  the  failure  rate  modeled  from  time  period  three  to  time 
period  nine  is  changing  at  a  faster  rate  than  was  the  case 
during  the  first  three  time  periods.  This  causes  the  pre¬ 
dictions  to  be  less  than  would  ordinarily  be  the  case.  This 
phenomenon  can  be  visualized  from  the  graphs. 

It  was  also  interesting  to  note  how  many  times  there 
was  not  enough  data  for  meaningful  results.  Th:.s  statistic, 
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Fig  3.  Comparison  of  Mean  Estimated  Curves 
(6  time  periods  *  50  missiles) 
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Fig  S.  Comparison  of  Mean  Estimated  Curves 
(12  time  periods  >  50  missiles) 
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Fig  6.  Comparison  of  Mean  Estimated  Curves 
(6  time  periods  -  60  missiles) 
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Fig  7.  Comparison  of  Mean  Estimated  Curves 
(9  time  periods  -  60  missiles) 
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Fig  8.  Comparison  of  Mean  Estimated  Curves 
(12  time  periods  *  60  missiles) 
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Fig  9.  Comparison  of  Mean  Estimated  Curves 
(6  ti»e  periods  -  70  missiles) 
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Fig  10.  Comparison  of  Mean  Estimated  Curves 
(9  tine  periods  -  70  missiles) 
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Fig  12.  Comparison  of  Moan  Estimated  Curves 
{6  time  periods  -  80  missiles) 
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Fig  13.  Comparison  of  Mean  Estimated  Curves 
(9  time  periods  -  89  missiles) 
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Fig  IS.  Comparison  of  Mean  Estimated  Curves 
(6  time  periods  -  90  sissiles) 


79 


Fig  16.  Comparison  of  Mean  Estimated  Curves 
(9  time  periods  -  90  missiles) 
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12  YEARS  DATA  USED 
90  MISSILES  PER  PERIOD  TESTED 


S.00  12.00  16.00  20 

TEST  TIMES 


00 


GOMPERTZ - 

BONIS - 

DUANE - 

TRUE  ARE  STARS 


Fig  17.  Comparison  of  Mean  Estimated  Curves 
(12  time  periods  -  90  missiles) 
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RELIABILITY 

cP.OO  0.25  0.60  0.75  1.00 


6  YEARS  DATA  USED 

100  MISSILES  PER  PER10O  TESTED 


TEST  TIMES 


GOMPERTZ - 

BONIS - 

DUANE - 

TRUE  RRE  STARS 


Fig  18.  Comparison  of  Mean  Estimated  Curves 
(6  time  periods  -  100  missiles) 
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RELIABILITY 


Fig  19.  Comparison  of  Mean  Estimated  Curves 
(9  time  periods  -  100  missiles) 


83 


Comparison  of  Mean  Estimated  Curves 
(12  time  periods  -  100  missiles) 


TABLE  V 


50  Missiles  Per  Period  Tested 


Six  Periods 

Data  Used 

Model 

Ml 

M2 

M3 

Gompe-'  cz 

1.388 

.234 

.054 

Bonis 

3.502 

1.463 

.461 

Duane 

3.486 

1.409 

.269 

Nine  Periods 

Data  Used 

Model 

Ml 

M2 

M3 

Gompertz 

.898 

.058 

.007 

Bonis 

1.965 

.553 

.222 

Duane 

1.913 

.429 

.080 

Twelve  Periods 

Data  Used 

Model 

Ml 

M2 

M3 

Gcmpertz 

2.506 

.534 

.083 

Bonis 

1.262 

.164 

.069 

Duane 

1.440 

.216 

.037 
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TABLE  VI 


60  Missiles  Per  Period  Tested 


Six  Periods  Data  Used 

Model 

Ml 

M2 

M3 

Gompertz 

1.  791 

.419 

.102 

Bonis 

2.826 

1.031 

.334 

Duane 

S.  167 

1.073 

.216 

Nino  Periods 

Data  Used 

Model 

Ml 

M2 

M3 

Gompertz 

.528 

.024 

.004 

Bonis 

2.035 

.602 

.221 

Duane 

1.348 

.182 

.037 

Twelve  Periods 

Data  Used 

Model 

Ml 

M2 

M3 

Gompertz 

2.372 

.49  3 

.033 

Bonis 

1.199 

.126 

.043 

Duane 

.882 

.063 

.013 

TABLE  VII 

70  Missiles  Per  Period  Tested 


Six  Periods 

Data  Used 

Model 

Ml 

M2 

M3 

Gompertz 

1.361 

.196 

.043 

Bonis 

3.360 

1.425 

.461 

Duane 

2.961 

.814 

.159 

Nine  Periods 

Data  Used 

Model 

Ml 

M2 

M3 

Gotapertz 

.971 

.068 

.010 

Bonis 

1.955 

.543 

.221 

Duane 

1.354 

.164 

.034 

Twelve  Periods 

Data  Used 

Model 

Ml 

M2 

M3 

Goapertz 

2.188 

.429 

.076 

Bonis 

1.260 

.165 

.069 

Duane 

.908 

.058 

.008 

TABLE  VIII 


80  Missiles  Per  Period  Tested 


Six  Periods 

Data  Used 

Model 

Ml 

M2 

M3 

Goapertz 

1.310 

.198 

.040 

Bonis 

3.268 

1.388 

.461 

Duane 

2.469 

.982 

.185 

Nine  Periods 

Data  Used 

Model 

Ml 

M2 

M3 

Goapertz 

.769 

.047 

.009 

Bonis 

1.948 

.549 

.221 

Duane 

1.372 

.155 

.028 

Twelve  Periods 

Data  Used 

Model 

Ml 

M2 

M3 

Goapertz 

2.42S 

.532 

.093 

Bonis 

1.143 

.132 

.042 

Duane 

.975 

.067 

.009 

TABLE  IX 


90  Missiles  Per  Period  Tested 


Six  Periods 

Dntn  Used 

Model 

Ml 

M2 

M3 

Gosper tz 

1.459 

.194 

.028 

Bonis 

3.765 

1.774 

.461 

Dunne 

2.316 

.481 

.091 

Nine  Periods 

Dntn  Used 

Model 

Ml 

M2 

M3 

Gosper tz 

.748 

.053 

.012 

Bonis 

1.790 

.492 

.221 

Dunne 

1.226 

.104 

.012 

|  Twelve  Periods 

Dntn  Used 

Model 

Ml 

M2 

M3 

Gospertz 

2.468 

.552 

.0V6 

Bonis 

1.189 

.148 

.055 

Donne 

1.188 

.113 

.019 

TABLE  X 

ICO  Missiles  Per  Period  Tested 


Six  Periods 

Data  Used 

Model 

Ml 

M2 

M3 

Gompertz 

1.481 

.226 

.048 

Bonis 

3.769 

1.785 

.466 

Duane 

2.402 

.502 

.100 

Nine  Periods 

Data  Used 

Model 

Ml 

M2 

M3 

Gonpertz 

.801 

.052 

.010 

Bonis 

1.BS2 

.510 

.221 

Duane 

1.490 

.160 

.024 

Twelve  Periods 

Data  Used 

Model 

Ml 

M2 

M3 

Gonpertz 

2. 395 

.522 

.092 

Bonis 

1.132 

.126 

.032 

Duane 

1.473 

.183 

.031 

VII.  Conclusions  and  Recommendations 


Military  engineers  face  many  important  reliability 
problems.  New  weapon  systems  are  being  designed  continu¬ 
ally,  and  many  of  these  systems  are  to  be  placed  in  long¬ 
term  storage  or  dormancy.  These  facts  make  both  reliability 
growth  and  dormant  reliability  important  corceins  to  mili¬ 
tary  analysts. 

This  study  provides  evidence  that  a  common  attribute 
of  reliability  growth  and  dormant  reliability  (both  are 
assumed  to  have  changing  failure  rates)  can  be  the  basis  of 
modifying  reliability  growth  methodology  for  predicting 
dormant  reliability.  In  Chapter  III,  the  methodology  used 
in  reliability  growth  analysis  is  presented.  Included  in 
this  section  are  the  mathematical  developments  and  examples 
of  how  to  use  five  well-known  reliability  growth  models. 
Also,, general  descriptions  of  many  other  reliability  growth 
models  are  outlined.  This  section  was  the  foundation  for 
the  Monte  Carlo  experiments  discussed  in  Chapters  V  and  VI. 
These  two  chapters  tie  together  the  efforts  of  this  study 
by  presenting  results  of  attempts  to  use  reliability  growth 
models  to  predict  dormant  reliability. 

The  results  of  the  simulation  Indicate  that  it  is 
possible  (at  least  potentially)  to  predict  dormant  relia¬ 
bility  with  reliability  growth  models.  The  graphs  shown  in 
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Chapter  VI  indicate  good  reliability  prediction  in  many 
cases.  However,  it  is  important  to  point  out  that  some  of 
the  underlying  assumptions  of  the  reliability  growth  models 
had  to  be  modified  before  they  were  used  to  predict  dormant 
reliability.  In  addition,  inconsistencies  wero  encountered 
with  the  Duane  and  Gompertz  models  which  could  not  be  re* 
solved  analytically.  These  points  emphasize  the  fact  that 
additional  work  in  this  area  is  needed  before  any  specific 
conclusion  can  be  made. 

Recommendations 

This  study  is  believed  to  be  the  first  attempt  to 
use  reliability  growth  models  to  predict  dormant  reliability 
Of  course,  this  means  there  are  many  areas  which  deserve 
further  study.  It  is  recommended  that  the  reader  who  wishes 
to  do  additional  work  in  this  area  consider  the  following: 

1)  Explore  the  problem  of  the  shift  in  the  predicted 
dormant  reliability  curves  that  was  notices  with 
both  the  Duane  and  the  Gompert:  models. 

2)  Use  Monte  Carlo  techniques  to  generate  dormant  data 
to  be  modeled  by  other  reliability  growth  models. 

The  time  series  analysis  suggested  by  Singpurwalla 
(Ref  SS)  appears  to  have  excellent  potential. 

3)  Analyze  the  results  of  using  ether  failure  distri¬ 
butions  for  each  of  the  subsystem  of  the  HM-1. 

4)  Develop  confidence  bound  for  the  predicted  dormant 
reliability  of  the  HM-1  using  Monte  Carlo  techniques. 
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t  is  also  recommended  that  this  stuc*y  be  used  as: 

1)  An  introduction  to  reliability  growth. 

Chapter  III  can  be  considered  an  introductory  text 
to  reliability  growth  and  reliability  growth 
modeling. 

2)  A  major  reference  source  for  reliability  growth. 

3)  >n  example  for  further  Monte  Carlo  analysis  of 
dormant  reliability  using  reliability  growth  models. 
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APPENOIXt  SIMULATION  DATA 


TABLE  XX 

Boap«rtz  Maim  and  Standard  Daviatlona 
Whan  SO  Miaailaa  par  Period  Wara  llaad 


I  A  Pariod*  Dtta 

9  Pariod*  Data 

12  Periods  Data 

Maan 

Std-Dv 

Maan 

Std-Dv 

Maan 

Std-Dv 

.991 

.012 

.996 

.009 

.994 

.006 

.990 

.013 

.993 

.006 

.992 

.007 

.967 

.013 

.993 

.007 

.990 

.009 

.963 

.012 

.990 

.006 

.966 

.010 

.970 

.011 

.966 

.01 0 

.981 

.012 

.964 

.013 

.979 

.011 

.979 

.014 

.941 

.033 

.967 

.011 

.966 

.019 

.696 

.069 

.947 

.014 

.993 

.016 

.623 

.179 

.913 

.031 

.934 

.016 

.732 

.279 

.632 

.078 

.908 

.013 

.643 

.349 

.796 

.163 

.670 

.019 

.966 

.370 

.634 

.293 

.817 

.040 

.900 

.379 

.918 

.291 

.744 

.070 

.437 

.386 

.413 

.292 

.691 

.127 

.379 

.394 

.318 

.284 

.941 

.160 

.332 

.403 

.240 

.266 

.434 

.166 

.299 

.407 

.160 

.249 

.329 

.192 

•  276 

.137 

.219 

.236 

.106 

.260 

.109 

.191 

.163 

.170 

.246 

.060 

.163 

.no 

.149 
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6  Par 

’lad*  Data 

EE 

12  Periods  Data 
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Corrportas  ft ~-*i»  «nd  Ctandard  Deviations 
IVsen  60  tiisailos  par  Period  War©  Used 


■ 

6  Pur  i  c-ii  ■%  Data 

9  P -tried*  Data 

12  PoriocJs  Data 

■ 

ftean 

Std-Dv 

r  -an 

Std-Dv 

Mean 

Std-Dv 

i 

1 

•  013 

.977 

.003 

.993 

.004 

2 

■ 

•  013 

•  f,  "  1 

.CO  4 

.993 

.003 

3 

.973 

.014 

.9  VO 

.0  "3 

.991 

.003 

,c;c3 

.013 

< . 

.CO  3 

.937 

.007 

.979 

.012 

.9  7 

.CO  6 

frn'T 

•  * 

.COO 

.967 

•  C 1 A 

.  7 

.037 

.976 

.009 

.9-73 

.<77 

.9.:  i 

.  C07 

.  966 

.010 

o 

.901 

.CV2 

.9  7.3 

.012 

.933 

.Oil 

MM 

•  1  .9 

.V  3 

.  c :  3 

.934 

.012 

19 

.726 

•  T  '  fl 

.'  71 

.072 

.907 

.012 

Etl 

.627 

a  .'•«> 

.774 

.  r. '  :2 

.969 

.013 

12 

.242 

•  W-*-  .>  > 

;i 

.:.  04 

•  C317 

.027 

13 

.470 

.421 

.  o  •  :> 

.270 

.746 

.030 

14 

.432 

.  42  j 

•  3  7  !* 

.277 

.634 

.003 

13 

•  400 

.473 

.207 

•  IT 

.344 

.121 

16 

.373 

.440 

.  193 

.7  73 

.423 

.130 

17 

.364 

.440 

.146 

.2:03 

.307 

.138 

la 

.233 

.444 

.111 

.7:3 

.207 

.149 

19 

.344 

.43  7 

.CM 

.  177 

.129 

.129 

20 

.334 

.426 

.0  73 

.  too 

.076 

.103 

r 

’?<3r  erf  Invalid  C 

•jtirjatav  Cut  of  30  Trl«« 

6  Par ieda  Data 

9  Pari r 7 a  Data 

12  Periods  Data 

— 

. . - 

O 

0 

» 

4  Par  ioda  Data 

9  Par 

‘ioda  Data 

12  Par ioda  Data 

1 

Naan 

Btd-Ov 

Naan 

Btd-Ov 

Naan  8td-Dv 

1 

•  493 

.010 

.444 

.003 

.944  .004 

2 

.444 

.010 

.493 

•004 

•944  .003 

3 

.442 

.010 

.473 

.004 

.492  .004 

4 

.404 

•OlO 

.440 

.007 

•904  .007 

S 

.403 

.010 

.404 

•ooo 

.904  .000 

* 

.471 

.013 

.474 

.000 

.477  .004 

7 

•  444 

.030 

•a*  aa 

•  ▼oaf 

.ooo 

.940  .011 

• 

.847 

.094 

.449 

.011 

.933  .012 

.004 

.143 

.417 

.003 

•433  .012 

to 

.492 

.303 

.043 

•034 

.400  .012 

11 

.302 

.371 

.701 

.119 

•040  .014 

12 

•  444 

.403 

•447 

.140 

•013  .023 

13 

.434 

.411 

.338 

*90000 

.737  .048 

14 

•  OCfO 

.403 

.417 

.281 

.430  .002 

13 

.343 

.343 

.314 

.203 

•319  .122 

14 

.304 

.341 

.233 

•270 

•390  .134 

17 

.273 

•  308 

.173 

•232 

.271  .144 

18 

.233 

.300 

.131 

•231 

•  174  .130 

14 

.237 

.370 

.101 

.212 

•  10O  .123 

20 

.221 

.340 

.000 

.143 

.043  .093 
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TABLE  XIV 


Soapflrtx  Nnhi  and  Standard  Deviations 
Mhsn  £0  Hissilss  per  Period  Mars  Uood 


■ 

4  Periods  Data 

1  9  Psriods  Data 

12  Psriods  Data! 

H 

Naan 

Std-Dv 

8td— Dv 

Mean 

Btd-Dv 

1 

.994 

.010 

.997 

.003 

.003 

2 

.993 

.Oil 

.994 

.004 

.994 

.004 

3 

.991 

.013 

.994 

.007 

.991 

•003 

4 

.9GB 

.991 

.007 

•  988 

.004 

3 

.902 

.010 

.984 

.008 

.983 

.004 

A 

.971 

.013 

.979 

.098 

.974 

.007 

7 

.948 

.034 

•  948 

.008 

.947 

•008 

• 

.901 

.098 

.948 

.010 

•  933 

.009 

V 

.820 

.202 

.913 

.027 

.934 

.009 

10 

.721 

.288 

oam 

•  CKjt 

•070 

.908 

.009 

11 

1 

•  344 

•772 

•  142 

.671 

•OlO 

12 

•382 

.438 

•  213 

•821 

•018 

13 

•448 

.394 

.334 

.232 

•  734 

.033 

14 

•  414 

•  392 

•414 

•239 

.447 

•034 

13 

.372 

•  383 

•  304 

.247 

.340 

•080 

14 

•  331 

.372 

•214 

.224 

•439 

•  112 

17 

.293 

.341 

.147 

.193 

.314 

•  129 

•241 

.349 

.093 

•  144 

.204 

.127 

1* 

.233 

.334 

.041 

.143 

.123 

•  112 

-22j 

•  209 

.322 

.040 

.128 

.047 

.091 
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TABLE  XVX 

Soapartz  h— na  and  Standard  Daviatiana 
Whan  100  Maailas  par  Par  lod  Kara  Uaad 


4  Parioda  Data 

9  Parioda  Data  j 

12  Par 

ioda  Data 

t  . 

Haan 

Sttf—Dv 

Haan 

St  d-Dv 

HCArt 

8td-Dv 

1 

.498 

.003 

.997 

mew 

•993 

•003 

2 

.997 

.003 

.994 

.994 

.004 

3 

.994 

.003 

.994 

.004 

.991 

.003 

4 

.992 

.004 

.992 

.003 

•988 

•004 

3 

.994 

.003 

.987 

.004 

.983 

.007 

4 

.970 

.017 

.980 

.007 

.977 

.008 

7 

.932 

.009 

.949 

.007 

.947 

•009 

• 

.849 

.134 

.930 

.OlO 

.934 

•OlO 

a 

.714 

.274 

.917 

.030 

•933 

•OlO 

io 

.3-77 

.347 

.842 

.909 

.009  . 

11 

.440 

.343 

•780 

.140 

.872 

.009 

12 

.340 

.344 

.470 

.184 

•822 

.013 

13 

.283 

.333 

.339 

•234 

.734 

•028 

14 

.228 

.342 

.407 

•240 

•444 

•090 

13 

.190 

.324 

•294 

•  240 

•331 

•078 

14 

.143 

.308 

.208 

.240 

•433 

•  107 

17 

.142 

.290 

.144 

•210 

.308 

.127 

13 

.124 

.272 

•  102 

.179 

.197 

•  131 

It 

.109 

.234 

.071 

.148 

.114 

•  118 

20  1 

.093 

*238 

.049 

•  119 

.043 

.094 
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ftoda  Data 

9  Ptrioda  Data 

12  Parioda  Data 

4 

0 
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TABLE  XVI XI 

Bonis  H Bans  and  Standard  Davlations 
Mhon  AO  Hitciltt  par  Par iod  Wars  Usad 


fl 

4  Parioda  Data 

Naan  8td-Dv 

9  Parioda  Data 

Naan  Std— Dv 

12  Parioda  Data 

Moan  8td-Dv 

_ 1 

1 

.703 

.007 

.774 

.011 

.744 

.173 

2 

.723 

.009 

.971 

.013 

.941 

*177 

3 

.797 

.010 

.788 

.013 

•  734 

•  180 

4 

.784 

.Oil 

.784 

.018 

.730 

.183 

9 

.774 

*012 

.777 

.021 

.741 

.184 

* 

.737 

.013 

•  944 

.024 

.730 

.188 

7 

.723 

.021 

.747 

.024 

.714 

.170 

9 

.873 

•  0P7 

.720 

.024 

.872 

.172 

7 

.777 

.142 

•  878 

•  030 

.840 

•  172 

to 

.974 

•  337 

.774 

.074 

.814 

.187 

II 

.242 

.774 

■CO** 
•  W74 

•  223 

.733 

.184 

12 

.221/ 

.401 

.442 

.174 

13 

.327 

.144 

14 

•334 

.177 

IS 

.743 

.274 

14 

17 

Waana  ar 

a  naoativa  in  this  araa 

of  tha  Tab  la. 

thsrsforsy 

IB 

calculations  ara  not  coosldarad 
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4  Parioda  Data 

7  Parioda  3at a 

12  Parioda  Data 

3i 

1 

0 
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TABLE  XXX 


Bonis  Heans  and  Standard  Dsvlatlons 
Nhsn  70  Hi sal las  par  Par iod  Kara  Usad 


6  Periods  Data 

9  Periods  Data 

12  Par 

iods  Data 

Haan 

Btd-Dv 

Haan 

8td~Dv 

Haan 

Btd-Dv 

.996 

.006 

.983 

.064 

.993 

.007 

.994 

.008 

.983 

.066 

.990 

.009 

.991 

.009 

.980 

.068 

.987 

.012 

.966 

.010 

.976 

.070 

.982 

.014 

.976 

.011 

.969 

.073 

.973 

.018 

.937 

•  .013 

.939 

.074 

.963 

.022 

.922 

.027 

.942 

.073 

.931 

.026 

.831 

.077 

.913 

.074 

.930 

.031 

.704 

•  207 

•  867 

.070 

.901 

.033 

.531 

.781 

.073 

.836 

.037 

.622 

.143 

.790 

.033 

.319 

.393 

.689 

.027 

.333 

.067 

.288 

.189 

Haans  ara  nagativa  In  this  araa 
of  tha  Table,  therefore, 
calculations  ara  not  consider ad 
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6  Periods  Data 

23 

9  Periods  Data 

0 

12  Periods  Data 

0 

TABLE  XX 


Bonis  Means  and  Standard  Deviations 
When  80  Missiles  per  Period  Mere  Used 


8  Periods  Data 

Mean  8td— Dv 

.998 

.008 

.994 

.007 

.991 

.006 

.988 

.009 

.977 

.009 

.981 

.010 

.923 

.023 

.884 

.077 

.730 

..438 

.220 
■800 _ 

.996 
.994 
.992 
.988 
.981 
.971 
•  9SS 
.927 
.880 
.793 
.833 


.003 

.006 

.007 

.009 

.011 

.014 

.018 

.017 

.020 

.038 

.199 


12  Periods  Data 

Mean  Btd-Dv 

.991 

.012 

.988 

.014 

.984 

.018 

.979 

.019 

.971 

.022 

.980 

.023 

.943 

.028 

.923 

.031 

.892 

.032 

.848 

.032 

.784 

.029 

.891 

.024 

.333 

.043 

.334 

.no 

.038 

.237 

Means  are  negative  in  this  area 
of  the  Table*  therefore* 
calculations  are  not  considered 


of  Invalid  Estimates  Out  of  30  Tri 


4  Periods  Data 

9  Periods  Data 

14 

0 

TABLE  XXX 


Bonis  Moans  and  Standard  Deviations 
Whan  90  Missiles  par  Period  Were  Used 


■ 

A  Periods  Data 

9  Periods  Data 

12  Period*  Data 

D 

Mean 

Btd-Dv 

Mean 

Std— Dv 

Mean 

Btd-Dv 

i 

.997 

.003 

.993 

.010 

.994 

.003 

2 

.993 

.006 

.991 

.012 

.992 

.004 

3 

.992 

.008 

.988 

.014 

.988 

.006 

4 

.988 

.009 

.983 

.01 A 

.984 

.007 

9 

.978 

.009 

.977 

.019 

.97  A 

.009 

6 

.960 

.010 

.966 

.021 

.  96A 

.012 

7 

.920 

.029 

.930 

.023 

.932 

.013 

B 

.629 

.102 

.923 

.023 

.930 

.019 

9 

.  A13 

.317 

.882 

.022 

.900 

.020 

10 

.810 

.040 

U 

•  A83 

.123 

.789 

.022 

12 

.448 

.349 

.  .  A93 

.021 

13 

f  *331 

.032 

14 

.340 

.080 

13 

.028 

.182 

1A 

17 

Means  ar 

e  negative  in  this  area 

ie 

of  the  Table. 

therefore. 

19  1 

calculations  are  not  considered 
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A  Periods  Data 

9  Periods  Data 

12  Periods  Data! 

■ 

S 

0 

0 
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TAT?£  XXII 

Bonis  naans  and  Standard  Deviations 
Whan  100  Hissilas  par  Pari od  Wars  lined 


■ 

6  Pariods  Data 

9  Periods  Data 

12  Par 

iods  Data 

B 

naan 

Std-Dv 

Hean 

Std-Dv 

hean 

Std-Dv 

i 

..996 

.009 

.993 

.003 

.993 

.007 

2 

.994 

.010 

.993 

.007 

*.990 

.008 

3 

.991 

.012 

.990 

.009 

.986 

.010 

.987 

.013 

.986 

.011 

.981 

.012 

.978 

.014 

.980 

.013 

.973 

.013 

.960 

.014 

.969 

.016 

.963 

.017 

.922 

.031 

.933 

.018 

.947 

.020 

.833 

.109 

.927 

.018 

.926 

.023 

.619 

.349 

.882 

.019 

.893 

.024 

10 

.083 

1.072 

.804 

.047 

.831 

.023 

11 

.663 

.163 

.798 

.022 

12 

.388 

.330 

.696 

.020 

13 

.363 

.033 

14 

.369 

.081 

13 

.084 

.170 

16 

17 

n»an«  mm 

3  negative  in  this  area 

18 

o*  the  Table, 

there*  ore. 

19 

calculations  arm  not  considered 

20 

Must 
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6  Periods  Data 

9  Periods  Data 

12  Periods  Data 

4 

• 

0 

0 

} 
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TABLE  XXIII 


Duane  Means  and  Standard  Deviations 
When  50  Missiles  per  Period  Were  Used 


■ 

6  Periods  Data 

9  Periods  Data 

12  Periods  Data 

H 

Mean 

Std-Dv 

Moan 

Gtd-Dv 

Moan 

Std-Dv 

.998 

.002 

.999 

.001 

.999 

.OOl 

.996 

.003 

.997 

.003 

.997 

.C02 

.993 

.003 

.993 

.003 

.993 

.003 

.987 

.003 

.983 

,007 

.924 

.003 

.975 

.016 

.973 

.010 

.971 

.010 

.953 

.044 

.934 

.013 

.920 

.013 

.911 

.122 

.926 

.026 

.922 

.016 

.861 

.201 

•  023 

.046 

.024 

.022 

.813 

.249 

•  C37 

.020 

.  833 

.033 

10 

.767 

.226 

.774 

.125 

.776 

.057 

11 

.724 

.322 

.703 

.173 

.707 

.039 

12 

.683 

•  >>*^5 

.631 

.223 

.732 

.124 

13 

.653 

.379 

.563 

.267 

.523 

.157 

14 

.628 

.393 

.504 

.291 

.431 

.182 

13 

.608 

.400 

.434 

.304 

.413 

.197 

16 

.591 

.405 

.411 

.310 

.  .333 

.203 

17 

.573 

.403 

.374 

.312 

.300 

.208 

18 

.560 

.410 

.343 

.311 

.253 

.206 

19 

.546 

.413 

.313 

.301 

.217 

.201 

20 

.534 

.416 

.291 

.306 

.  103 

.194 

Kusbcr  of  Invalid  Estinatca  Chit  of  5 

■ 

6  Periods  Data 

9  Periods  Data 

12  Periods  Data 

■ 

9 

0 

0 
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TABLE  XXIV 


Duane  Means  and  Standard  Deviations 
Whan  60  Hi  soil  as  par  Par  iod  Wars  lisad 


■ 

6  Periods  Data 

9  Periods  Data 

12  Periods  Data 

D 

Mean 

Std-Dv 

Mean 

Std-Dv 

Kean 

Std-Dv 

.998 

.002 

.999 

.001 

.999 

.001 

.997 

.003 

.997 

.003 

.997 

.002 

.993 

.004 

.993 

.004 

.992 

.004 

.987 

.007 

.984 

.007 

.983 

.007 

.973 

.016 

.969 

.009 

.964 

.00/ 

.942 

.034 

.943 

.014 

.941 

.0-2 

.881 

.136 

.909 

.028 

•  904 

.0  6 

!  B 

.810 

.233 

.838 

.033 

.839 

.e  a 

n 

.749 

.308 

.791 

.097 

.799 

.041 

B m 

.697 

.330 

.712 

.131 

.728 

.064 

Bfl 

.636 

.373 

.427 

.204 

.448 

.093 

12 

.623 

.389 

.343 

.244 

.342 

.224 

13 

.394 

.402 

.473 

.271 

.477 

•  ;.S2 

14 

.370 

.412 

.413 

.283 

.394 

.174 

13 

.349 

.419 

.361 

.287 

.188 

16 

.331 

.424 

.318 

•  288 

.244 

.194 

17 

.316 

.427 

.281 

.284 

.214 

.194 

.8 

.302 

.430 

.231 

.282 

.173 

•  191 

19 

.490 

.432 

.224 

.278 

.143 

•  183 

20 

.479 

.434 

.202 

.277 

.119 

.179 

s 

Nuffifc 
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6  Periods  Data 

9  Periods  Data 

12  Periods  Data 

■ 

2 

0 

O 
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TABLE  XXVI 


Duant  Means  and  Standard  Deviations 
Whan  80  Missiles  par  Period  M -sra  Used 


4  Periods  Data 

9  Periods  Data 

12  Periods  Data 

t 

Mean 

Std-Dv 

Mean 

Std-Dv 

Mean 

Std-Dv 

1 

.998 

.002 

.999 

.001 

.999 

.001 

2 

.993 

.004 

.994 

.003 

.994 

.003 

3 

.989 

•  003 

.989 

.004 

.989 

.003 

4 

.980 

.008 

.947 

.008 

.973 

.009 

S 

•  943 

.013 

.934 

.010 

.933 

.011 

4 

.941 

.033 

.924 

.013 

.920 

.013 

7 

.904 

.077 

.883 

.028 

.073 

.013 

8 

.839 

.139 

.832 

.032 

.818 

.022 

9 

.807 

.194 

.744 

.084 

.730 

.034  • 

io 

.734 

.237 

.492 

.127 

.471 

.034 

il 

.704 

.274 

.413 

.147 

.383 

.079 

12 

.440 

.303 

.334 

.201 

.497 

.102 

13 

.419 

.328 

.444 

•  224 

.412 

.121 

14 

.383 

.344 

.400 

.238 

.333 

.134 

13 

•  331 

.338 

.344 

.243 

.243 

.140 

14 

•  324 

.347 

.300 

.242 

.207 

.138 

17 

.301 

.373 

.241 

.238 

.141 

.132 

18 

.480 

.374 

.228 

.232 

.123 

.123 

19  1 

•  441 

.379 

.200 

.223 

.097 

.113 

20 

.444 

.380 

•  174 

.217 

.076 

.102 

Nuaf 

bar  of  Invalid  Estimates  Out  of  SO 

Tries 

4  Periods  Data 

9  Periods  Data 

12  Periods  Data 

0 

0 

0 

US 


/ 
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TABLE  XXVI I 


Duane  Moons  and  Standard  Deviations 
Mhon  90  Missiles  per  Period  Mere  Used 


6  Per 

iods  Data 

Mean 

8td-Dv 

.998 

.002 

.999 

.004 

.989 

.006 

.977 

•  008 

.996 

.017 

.921 

.049 

.867 

.101 

.799 

.178 

.718 

.247 

.648 

.292 

.987 

.321 

.492 

.390 

.496 

.394 

.429 

•  399 

.398 

.394 

.379 

.392 

•  393 

.390 

•334 

.348 

•  317 

.346 

9  Periods  Data 

Mean  Std-Dv 

.999 

.001 

.996 

.004 

.988 

.007 

.974 

•  .010 

.991 

.013 

.918 

.016 

.872 

.024 

.813 

.041 

.741 

.067 

.660 

.100 

.572 

.134 

.486 

.166 

.406 

.190 

.337 

.202 

.279 

.204 

.231 

.201 

.193 

.193 

1  .162 

.183 

1  .138 

.172 

|  .117 

.160 

of  Invalid  Estimates  Out  of  90  Tries 


4  Periods  Data  1 4  Periods  Data  1 12  Periods  Dati 


0 


TABUE  XXVI I I 
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Duane  Hean*  and  Standard  Deviations 
Whan  100  Hi sal las  par  Period  Ware  Used 


■ 

6  Periods  Data 

9  Periods  Data 

12  Periods  Data 

H 

Mean 

Std-Dv 

Mean 

Std-Dv 

Hean 

Std-Dv 

i 

.998 

.004 

.999 

.001 

.999 

.001 

2 

.994 

.003 

.993 

.004 

.994 

.003 

3 

.987 

.007 

.907 

.007 

.987 

.007 

4 

.973 

.009 

.971 

.011 

.970 

•  Oil 

a 

.932 

.018 

.944 

.013 

.942 

.013 

4 

.913 

.031 

.908 

.017 

•  902 

.017 

7 

.832 

.128 

.834 

.031 

OJQ 

•  CWI 

.018 

0 

.782 

.191 

.788 

.039 

.778 

.023 

9 

.707 

.244 

.704 

•  098 

.493 

.041 

10 

.433 

.293 

.414 

.142 

.401 

.044 

11 

.372 

.327 

•  324 

.179 

.303 

.089 

12 

.319 

.331 

.411 

.204 

.408 

•  lit 

13 

.477 

.343 

.347 

.221 

.321 

.123 

14 

.443 

.373 

.304 

.227 

.244 

.131 

13 

.414 

.374 

.234 

.224 

•  184 

.129 

14 

.393 

.374 

•  214 

.220 

•  140 

.121 

17 

.373 

.373 

.184 

.210 

.103 

.109 

18 

.338 

.372 

.139 

.199 

.079 

.097 

19 

.343 

.349 

.138 

.IBS 

.040 

.083 

20 

.330 

•  344 

•  121 

.174 

.043 

.074 

Nuaber  of  Inv 

'slid  Estimates  Out  of  30  Trie* 

■ 

4  Periods  Data 

9  Periods  Data 

12  Periods  Data 

■ 

0 

0 

0 
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